Updating ontology (.obo) files for the OA

This SOP is for updating the Object names obo files in the OA

Updating local acedb to latest available WS (instructions from Wen)

You have to download the latest build from the Sanger website. From the command line (X11 on Mac OS), go to the local directory where the old WS is installed. Login anonymously to Sanger’s ftp site

bash-3.2$ ftp ftp.sanger.ac.uk
Connected to ftpservice2.sanger.ac.uk.
220-ftp.sanger.ac.uk NcFTPd Server (free educational license) ready.
220-Wellcome Trust Sanger Institute FTP server
220-
220-Problems after login? Try using '-' as the first character of you
220-password.
220-
220-****
220-****
220-**** 7/9/06 FTP Server upgraded please report any problems to
220-****    ftpadmin@sanger.ac.uk
220-****
220 
Name (ftp.sanger.ac.uk:Yook): anonymous
331 Guest login ok, send your complete e-mail address as password.
Password: 

Go to directory containing WS releases Download whole release (takes about 1 hour) Quit ftp

FTP> cd pub/wormbase
FTP> get WS188.tar 
[or get –R WS188 for Ncfp client]
FTP> bye

Unzip tar Get into the new WS directory and run install to install new database (~15 minutes)

$ tar –xvvf WS188.tar
$ cd WS188
$./INSTALL

The readout after installation is as follows:

ACEDB installation script:
Yook will be known as the acedb-administrator
We are going to install the acedb system in the present directory: 
    /Users/Yook/WS_latest/WS188
This is your available disk space in this directory: 
Filesystem   1024-blocks      Used Available Capacity  Mounted on
/dev/disk0s2   488050672 149925748 337868924    31%    /
The amount of space you need will depend on what data you are installing.
For the source code and binary, you need around 15 Mb.
Should we proceed?  Please answer yes/no : yes

Exchange newest release with older one by removing old release and or change ./xace launch path to new release etc. $ rm <old WS release>

AQL Queries for updating the variation file for the OA

Instructions for retrieving object connections from the latest WS build

Variation-gene, variation-paper connections are used to filter out the variation term drop down list to keep the size of the autocomplete file manageable. The total variation object class is filtered for those variations that are called 'allele's' or have a gene connection (which includes transposon variations). The files used for filtering this list needs to be updated with each release. To update this info, the following AQL queries need to be performed on the newest release and deposited on tazendra for the updating scripts.

Variation_gene connections

Find all variations in the allele group (excludes SNPs etc.) along with the WBGeneID and public gene name of the gene they are assigned, if that is available. You will be making a file named WS200_vargene.txt that is a combination of WS200_vargene0.txt and WS200_transposons.txt

• WS200_vargene.txt

select g, g->gene, g->gene->public_name, g->reference from g in class variation where exists_tag g->allele 
Export as WS200_vargene.txt to your desktop (choose Separator character set to blank (TAB))

• WS200_transposons.txt

select v, v->gene, v->gene->public_name, v->reference from v in class variation where exists_tag v->transposon_insertion and exists v->gene
Export as WS200_transposons.txt to your desktop (choose Separator character set to blank (TAB))

• Make WS200_vargene.txt by copying and pasting WS200_transposons.txt to the end of WS200_vargene.txt and saving as WS200_vargene.txt
• total_variations.txt

select v, v->gene, v->gene->public_name, v->reference from v in class variation
Export as total_variations.txt to your desktop (choose Separator character set to blank (TAB))

//This is required for building an exclusion list that filters out SNPs

Transgene_summary_paper connections

List transgenes already linked to a paper

• WS200_transpapsum.txt

select t, t->reference, t->summary from t in class transgene where exists t->reference
Export as WS200_transpapsum.txt to your desktop (choose Separator character set to blank (TAB)) 

Rearrangement_inside_gene connections

List rearrangements with LG, 'genes inside' and ‘gene outside’ (public names only)

• WS200_rearragene.txt

select r, r->map, r->gene_inside->public_name, r->gene_outside->public_name from r in class rearrangement
Export as WS200_rearragene.txt your desktop (choose Separator character set to blank (TAB))

---

Repopulating .obo's

Two scripts run off of these files to update the .obo's for the OA. The scripts are on tazendra and run off of files Variation_gene.txt, transgene_summary_reference.txt and rearr_simple.txt. So files need to be transferred to tazendra and renamed to be recognizable by those scripts.

Transfer files to tazendra

From within the directory that contains the files you just downloaded send files to acedb@tazendra.caltech.edu:/home/acedb/jolene/WS_AQL_queries

• Send and Rename WS200_vargene.txt to Variation_gene.txt

$ scp WS200_vargene.txt acedb@tazendra.caltech.edu:/home/acedb/jolene/WS_AQL_queries/Variation_gene.txt 

• Send and Rename WS200_rearragene.txt to rearr_simple.txt

$ scp WS200_rearragene.txt acedb@tazendra.caltech.edu:/home/acedb/jolene/WS_AQL_queries/rearr_simple.txt 

• Send and Rename WS200_transpapsum to transgene_summary_reference.txt

$ scp WS200_transpapsum.txt acedb@tazendra.caltech.edu:/home/acedb/jolene/WS_AQL_queries/transgene_summary.txt 

$ scp total_variations.txt acedb@tazendra.caltech.edu:/home/acedb/jolene/WS_AQL_queries/total_variations.txt

Scripts that repopulate the OA '.obo' files

• Repopulates the OA autocomplete file (full rewrite of the tables= >50 minutes) http://tazendra.caltech.edu/~azurebrd/cgi-bin/forms/generic.cgi?action=UpdateVariationObo

• 'on-the-fly' update to the variation list (quick <40 sec) http://tazendra.caltech.edu/~azurebrd/cgi-bin/forms/generic.cgi?action=AddToVariationObo Use this one if you just want to add variations that were recently created on the variation name server.

• Cron job: populate_newobjects_cgi_postgres_tables.pl updates information based on Variation_gene.txt and transgene_summary.txt. This script is required for posting new allele and transgene entries on to the New objects cgi and sending notifications to the relevant curators. (Make sure files are named accordingly or the program won’t see them).

Obsolete

Note: As of 6/10/2010, we have discontinued the use of the 'New Variation!' object cgi page

make_obo.pl creates a text .obo based on rearr_simple.txt and Variation_gene.txt. This script used to populate the WS current info (which was needed for the Term info Display in the phenote). now obsolete and replaced by a web launchable script http://tazendra.caltech.edu/~azurebrd/cgi-bin/forms/generic.cgi?action=AddToVariationObo

Both apps are on tazendra in the same directory as the updated variation info.

cd to /home/acedb/jolene/WS_AQL_queries/
$ ./populate_newobjects_cgi_postgres_tables.pl
$ ./make_obo.pl

-Jolene

---

NOTE: populate_gin_variation updates data based on variation_tab_wbgene file (in postgres / cgi) , which is no longer current.

To check if the re-population scripts worked, check out the WS_current info field The date will tell you when it was last updated; it should reflect the date the script was run.

back

--kjy