Difference between revisions of "November 25, 2009 - Sequence Curation Flags"

From WormBaseWiki
Jump to navigationJump to search
Line 63: Line 63:
 
! Flag email (from first pass form)
 
! Flag email (from first pass form)
 
! Getting author flags?
 
! Getting author flags?
! Current approach
+
! Approach
 
! Curator(s)
 
! Curator(s)
 
! Comments
 
! Comments
Line 76: Line 76:
 
! Kimberly, Mary Ann?
 
! Kimberly, Mary Ann?
 
! Currently being combined with seqchange.  Could possibly employ secondary screen with categories.
 
! Currently being combined with seqchange.  Could possibly employ secondary screen with categories.
!
+
! Still being assessed.
 
|-
 
|-
 
! mapping data
 
! mapping data
Line 83: Line 83:
 
! genenames
 
! genenames
 
!
 
!
!  
+
! possibly keywords or categories
 
!  
 
!  
 
!
 
!
Line 93: Line 93:
 
! worm-bug, stlouis, xiaodong (xdwang)
 
! worm-bug, stlouis, xiaodong (xdwang)
 
!
 
!
 +
! possibly keywords or categories
 
!
 
!
 
!
 
!
!
+
! SVM tried, but recall was low
!
 
 
!
 
!
 
|-
 
|-
Line 105: Line 105:
 
!
 
!
 
! Textpresso categories
 
! Textpresso categories
! Ruihua, Gary?
+
! Ruihua, Gary
!
 
 
!
 
!
 +
! will likely be a small number (10?) of papers each year
 
!
 
!
 
|-
 
|-
Line 115: Line 115:
 
! worm-ticket, worm-bug
 
! worm-ticket, worm-bug
 
!
 
!
! tried SVM
+
! re-try SVM with new training set provided by Paul Davis
 
! Gary, Paul Davis
 
! Gary, Paul Davis
 
! Ideally divided into four categories: a change in a gene's structure, the addition of an isoform, a change to one of the SL1/SL2 or polyA site features, a sequence correction in the N2 reference genome
 
! Ideally divided into four categories: a change in a gene's structure, the addition of an isoform, a change to one of the SL1/SL2 or polyA site features, a sequence correction in the N2 reference genome
Line 126: Line 126:
 
!
 
!
 
! SVM
 
! SVM
!
+
! Kimberly has assessed some, will put on wiki, anyone from Sanger interested in checking?
!
+
!  
 
!
 
!
 
|-
 
|-
Line 137: Line 137:
 
!
 
!
 
!
 
!
!
+
! Most new SNP information comes via user submission emails.  Can remove this data type from the pipeline.
 
!
 
!
 
|-
 
|-
Line 147: Line 147:
 
!
 
!
 
!
 
!
!
+
! Double-check with Mary Ann about author flags, but pipeline between Caltech and Sanger is in place.
 
!
 
!
 
|-
 
|-

Revision as of 14:25, 25 November 2009

Back to Caltech documentation

Call information

4:30pm GMT | 11:30am EST | 10:30am CST | 8:30am PST

US: 1-877-384-2311, +1-480-629-1629

UK: 0800-358-3475, +44-207-154-0025

Canada: 1-866-243-1291

participant access code: 822114

Location: wherever you are

Participants

Review sequence-related first pass flags

http://tazendra.caltech.edu/~postgres/cgi-bin/curator_first_pass.cgi

What type of data is going into each flag?

Pipelines and options for flagging

Data may come into WormBase via various pipelines (e.g. Genbank, Knockout Consortia, user submissions) but for flagging data in published papers, here are the current pipelines:

SVMs

  • Curated papers are the best training set. Flagged papers can be used, if flagging was generally consistent.
  • Curation status form has lists, but not completely up-to-date.
  • How to evaluate the results of the SVMs
    • Precision - Of the returned positives, how many are true positives?
    • Recall - Of the true positives, how many were returned? (need to look at negatives for particular data type)
    • What precision and recall values are acceptable?
  • Is there any way for curators to see a list of features for each SVM? May help with understanding false positives.


Textpresso

  • pattern matching
  • category searches


Author flags

  • Curators need to tell Juancarlos they'd like to receive emails when authors flag a data type.
  • Caltech needs to supply list of papers flagged since September 2009.
  • Stats on return rates as of November 12, 2009 (supplied by Juancarlos):

Since Sept 1st, we have sent out 195 requests, and gotten back 72 results (36.9%).

Since Oct 1st, we have sent out 147 requests, and gotten back 52 results (35.3%).

Since Nov 1st, we have sent out 18 requests, and gotten back 7 results (38.9%).

Current status of each sequence-related flag

}
Flag name Flag information Number of papers flagged manually (from curation status form) Flag email (from first pass form) Getting author flags? Approach Curator(s) Comments Current pipeline sufficient?
gene symbol newly cloned gene or new name for previously known gene 342 genenames, vanauken no-vanauken SVM (see comments) Kimberly, Mary Ann? Currently being combined with seqchange. Could possibly employ secondary screen with categories. Still being assessed.
mapping data genetic mapping data 194 genenames possibly keywords or categories
sequence features regulatory sequence features, includes promoters, enhancer, elements in mRNA 248 worm-bug, stlouis, xiaodong (xdwang) possibly keywords or categories SVM tried, but recall was low
mass spectrometry mass spec analysis 65 gw3, worm-bug Textpresso categories Ruihua, Gary will likely be a small number (10?) of papers each year
structure correction gene structure corrections (see comments) 333 worm-ticket, worm-bug re-try SVM with new training set provided by Paul Davis Gary, Paul Davis Ideally divided into four categories: a change in a gene's structure, the addition of an isoform, a change to one of the SL1/SL2 or polyA site features, a sequence correction in the N2 reference genome
sequence change sequence of mutant alleles 981 genenames SVM Kimberly has assessed some, will put on wiki, anyone from Sanger interested in checking?
new SNPs new polymorphisms 50 tbieri Most new SNP information comes via user submission emails. Can remove this data type from the pipeline.
new mutant - alleles new phenotypes for new or existing (?) alleles 1372 Erich, Gary, Jolene Double-check with Mary Ann about author flags, but pipeline between Caltech and Sanger is in place.

Minutes, Action Items