[ADMB Users] Software Methods

[Richard Methot]

Software catalogs are useful,  but only a partial solution.  SISAM is
working on a classification protocol for assessment methods that hopefully
can help guide assessment practitioners towards the most appropriate tool
for their situation.  Software validation (e.g. does it work correctly) is
not too challenging.  The bigger challenges are performance testing under a
range of data quality, data type, and time series contrast situations.
 Perhaps that is what you intended under the topic of validation.   Another
large challenge is development of "good practices" for use of any software
system (e.g., under what conditions should one allow for changes in the
degree of age-selectivity?).  I am hopeful that SISAM will attract papers
to address these latter two challenges.  SISAM can also be a start of a
global catalog and a springboard for development of a next generation,
generalized assessment framework that will implement the good practices
that have been developed.

Rick


On Fri, Apr 20, 2012 at 5:05 AM, Laurie Kell <laurie.kell at iccat.int> wrote:

> In ICCAT we have a software catalogue, which requires certain criteria
> to be fulfilled, if software are to be used in stock assessment.
>
> I would like those criteria to be reviewed so that we follow best
> practice. I know that software validation is a complex issue but  would
> like to ensure consistency and exchange of methods between
> organisations. For example if a method is in the NOAA Toolbox or is on
> the R CRAN repository shouldn´t we be able to use it in ICCAT.
>
> This will not take long (hopefully). All I am looking for is a quick
> review of our criteria and any appropriate criteria used elsewhere, that
> we would need to include if our software is to be used by others. Also
> suggestions of how to harmonise software validation in the future so
> that we can strengthen the support for stock assessment experts and
> develop an improved network of stock assessment developers. I would also
> like to suggest that a global repository of all stock assessment methods
> would be useful.
>
>
> --
> Laurence Kell
>
> ICCAT Secretariat
> Population Dynamics Expert
> C/ Corazón de María, 8 - 6º
> 28002 Madrid. Spain
> Tel:   (00 34) 91 4165600
> Fax:   (00 34) 91 5103710
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.admb-project.org/pipermail/users/attachments/20120420/bd2f75ad/attachment.html>