Difference between revisions of "Documentation for workflow and scripts"

From WormBaseWiki
Jump to navigationJump to search
(added acedb info)
Line 8: Line 8:
 
  parallel_path.txt is the path to where GNU Parallel is installed.
 
  parallel_path.txt is the path to where GNU Parallel is installed.
 
  cgi.txt is the location of the scripts.
 
  cgi.txt is the location of the scripts.
 +
acedb_port.txt is the location of the port of the acedb server.
 +
acedb_host.txt is the IP address/hostname of the acedb server.
  
 
Make sure that the files in the docroot or /var/www directory in which the data are stored report the current production release, release of sources and the list of Wormbase supported species:
 
Make sure that the files in the docroot or /var/www directory in which the data are stored report the current production release, release of sources and the list of Wormbase supported species:

Revision as of 21:25, 4 September 2015

The software for automated concise descriptions is available online: https://github.com/WormBase/automated_descriptions The requirements are outlined here: http://wiki.wormbase.org/index.php/Generation_of_automated_descriptions

The following files in the cgi-bin or wherever the scripts for concise descriptions are hosted must be written:

db_ip.txt is the IP address of the SQL database that holds much of the daily updated information for Wormbase.
html.txt  is the location of the docroot or /var/www directory for the output.
parallel_path.txt is the path to where GNU Parallel is installed.
cgi.txt is the location of the scripts.
acedb_port.txt is the location of the port of the acedb server.
acedb_host.txt is the IP address/hostname of the acedb server.

Make sure that the files in the docroot or /var/www directory in which the data are stored report the current production release, release of sources and the list of Wormbase supported species:

 production_release.txt will hold the production release for the output of the concise descriptions.
 release.txt            holds the release information for the sources.
 species.txt            lists the tab separated values of the species abbreviation, project name, 
                        full name and gene prefix for each species:
                        c_briggsae	PRJNA10731	Caenorhabditis briggsae	Cbr

The first step is to go to the directory that includes the location of the scripts.

Then create the directories needed by the scripts for a given production release:

$ ./create_release_directories_parallel.pl WS250

There are input files that must be downloaded and formatted for input; the following scripts must be run:

$ ./biomart_query.pl
$ ./download_gene_lists_elegans.pl
$ ./download_orthologs_all_parallel.pl
$ ./download_gene_associations_parallel_all.pl
$ ./go_terms_only.pl
$ ./get_alt_id_terms_only.pl
$ ./go_obo_to_go_ace.pl
$ ./list_dead_genes.pl
$ ./create_curated_gene_list.pl
$ ./list_uncurated_genes.pl
$ ./create_gene_list.pl
$ ./parse_gene_lists_elegans.pl
$ ./parse_orthologs_all_parallel.pl
$ ./acedb_gene_class.pl
$ ./publication_gene.pl

Then the creation of the concise descriptions begin:

$ ./create_GO_sentences_elegans_species_parallel_all.pl 
  && ./create_sentence_multiple_orthologs_species_all_parallel_all.pl && ./create_GO_sentences_species_parallel_all.pl 
  && ./concatenate_sentences_species_parallel_all.pl && ./generate_OA_concise_descriptions_parallel_all.pl

For curation purposes only, one can create a file named "WBGenes_descriptions_for_manual.txt" to list genes that have been curated manually with updated gene ontology and orthology data:

$ ./create_curated_gene_sentences_elegans.pl

Finally, a report is written to detail the number of concise descriptions for each species for a given production release:

$ ./total_description_count.pl WS250

If one wants to examine gene popularity for C. elegans in the literature, one can type:

$ Rscript textpresso_gene_popularity.R WS250

The output will be a PDF file named, textpresso_gene_popularity.pdf.

Back To Generation of automated descriptions