Difference between revisions of "WormBase-Caltech Weekly Calls"

From WormBaseWiki
Jump to navigationJump to search
(420 intermediate revisions by 9 users not shown)
Line 16: Line 16:
  
 
[[WormBase-Caltech_Weekly_Calls_2017|2017 Meetings]]
 
[[WormBase-Caltech_Weekly_Calls_2017|2017 Meetings]]
 +
 +
[[WormBase-Caltech_Weekly_Calls_2018|2018 Meetings]]
  
  
Line 21: Line 23:
  
  
= 2018 Meetings =
+
= 2019 Meetings =
 
 
[[WormBase-Caltech_Weekly_Calls_January_2018|January]]
 
 
 
[[WormBase-Caltech_Weekly_Calls_February_2018|February]]
 
 
 
[[WormBase-Caltech_Weekly_Calls_March_2018|March]]
 
 
 
[[WormBase-Caltech_Weekly_Calls_April_2018|April]]
 
 
 
[[WormBase-Caltech_Weekly_Calls_May_2018|May]]
 
 
 
[[WormBase-Caltech_Weekly_Calls_June_2018|June]]
 
  
[[WormBase-Caltech_Weekly_Calls_July_2018|July]]
+
[[WormBase-Caltech_Weekly_Calls_January_2019|January]]
  
 +
[[WormBase-Caltech_Weekly_Calls_February_2019|February]]
  
== August 2, 2018 ==
+
[[WormBase-Caltech_Weekly_Calls_March_2019|March]]
  
=== AFP ===
+
[[WormBase-Caltech_Weekly_Calls_April_2019|April]]
  
* The AFP pipeline is currently emailing authors from karen's e-mail address
+
[[WormBase-Caltech_Weekly_Calls_May_2019|May]]
* Use same e-mail account Chris is using for phenotype community curation requests or create a new account for AFP (gmail)
 
* Can use outreach@wormbase.org for consistency
 
* May use the PMID in the subject line so e-mails will not be all in the same thread
 
* Todd and Chris have email credentials
 
** Chris will send to Valerio, Juancarlos, Daniela, and Kimberly
 
* Let Valerio and Juancarlos know what pipelines use AFP before they modify
 
* Do curators still want to receive emails when authors flag their data type?
 
** We will leave the alert emails as is for now
 
  
 +
[[WormBase-Caltech_Weekly_Calls_June_2019|June]]
  
== August 9, 2018 ==
+
[[WormBase-Caltech_Weekly_Calls_July_2019|July]]
  
=== AFP ===
+
[[WormBase-Caltech_Weekly_Calls_August_2019|August]]
* Mei Zhen, SAB member suggested that we include disease models in the AFP form.
 
* The AFP group will work with Ranjana to incorporate it. Ranjana will prepare a mock by next week.
 
* We will then decide about using the existing afp_humdis tables or creating new ones.
 
  
=== Tazendra ===
 
  
* Shall we move tazendra.caltech.edu to the cloud? Either WormBase cloud or Caltech cloud?
+
== September 12, 2019 ==
  
 +
=== Update on SVM pipeline ===
 +
* New SVM pipeline: more analysis and more parameter tuning
 +
* avoiding precision (and F-value) as a measure (dependent on ratio of positives and negatives in test set)
 +
* For example shown, "dumb" machine starts out with precision above 0.6
 +
* G-value (Michael's invention); does not depend on distribution of sets
 +
* Applied to various data types
 +
* Analysis: 10-fold cross validation
 +
** Randomly select 10% pos and neg (without replacement) and repeat until all papers sampled
 +
* F-value changes over different p/n values; G-value does not (essentially flat)
 +
* Area Under the Curve (AUC): probability that a random positive scores higher than random negative
 +
* AUC values for many WB data types upper 80%'s into 90%'s
 +
* Ranjana: How many papers for a good training set? Michael: we don't know yet
 +
* Can't reproduce old training sets (for old SVM); provide Michael better training sets if you want improved SVM
 +
* If SVM still not good enough, Michael will work on deep neural networks (Tensor Flow)
 +
* Michael can provide training sets he has used recently
  
 +
=== Clarifying definitions of "defective" and "deficient" for phenotypes ===
 +
* WB phenotype ontology has many "variant/abnormal" terms and distinct subclass terms for "defective/deficient"
 +
* Have tried to create a logical definition pattern for these terms, but the vagueness of the meaning of "defective" and how it is distinct from "abnormal" has stalled the process
 +
* What do we mean exactly by "defective" and how, specifically, is this distinct from "abnormal"?
 +
* Definitions include meanings or words:
 +
** "Variations in the ability"
 +
** "aberrant"
 +
** "defect"
 +
** "defective"
 +
** "defects"
 +
** "deficiency"
 +
** "deficient"
 +
** "disrupted"
 +
** "impaired"
 +
** "incompetent"
 +
** "ineffective"
 +
** "perturbation that disrupts"
 +
** Failure to execute the characteristic response = abnormal?
 +
** abnormal
 +
** abnormality leading to specific outcomes
 +
** fail to exhibit the same taxis behavior = abnormal?
 +
** failure
 +
** failure OR delayed
 +
** failure, slower OR late
 +
** failure/abnormal
 +
** reduced
 +
** slower
  
== August 16, 2018 ==
+
=== Citace upload ===
 +
** Tuesday, Sep 24th
  
=== Tazendra ===
+
=== Strain to ID mapping ===
* Moving to cloud? To avoid local hardware issues?
+
* Waiting on Hinxton to send strain ID mapping file?
* Need to discuss with Juancarlos and Paul S.
+
* Hopefully we can all get that well before the upload deadline
* Need to consider logistics; put all of Tazendra functionality on cloud? Keep some things local?
+
* Will do global replacement at time of citace upload (at least for now)
** Postgres in cloud; forms local? Paper pipeline?
 
** Will consult with Textpresso
 
  
=== ICBO 2018 recap ===
+
=== New name server ===
* POTATO workshop (Phenotype Ontologies Traversing All The Organisms)
+
* When will this officially go live?
** Will work towards generating standardized logical definitions using Dead Simple OWL Design Patterns (DOSDP)
+
* Will we now be able to request strain IDs through the server? Yes
*** <Quality> and inheres_in some <Entity> (and has_modifier some <Mod>)
 
*** Exercise: Reconciling logical definitions for apparently equivalent phenotype terms across ontologies (e.g. MP vs. HP)
 
** Can use Protege to edit the OWL ontology and ROBOT for automating generation of many terms and logical definitions in parallel
 
** Will try to align WPO to UPheno as best as we can; will depend (at least in part) heavily on alignment with Uberon for anatomy
 
** Some Uberon alignment challenges: e.g. Fruit fly "tibia" and human "tibia"; human "tibia" parent is "bone" but fly "tibia" is not a bone
 
** Will participate in Phenotype Ontology Developer's call, every 2 weeks on Tuesdays (9am Pacific, 12pm East coast, 5pm UK)
 
*** Next meeting September 4, 2018
 
** Crash course in Protege, ROBOT, Ontology Development Kit, using GitHub to help develop OWL ontologies
 
** PATO needs work
 
** Questions that arose:
 
*** What should the scope of an ontology term be? Context? Life stage? Conditions? Treatment?
 
*** Being weary of ontology term count explosion; what's the right balance?
 
*** When defining phenotype terms, should the cause be included or only the observation? Maybe causes as a subclass (and assuming the observation includes assessment of cause)
 
** Some distinction between human phenotype terms and model organism terms: phenotype of individual vs. population
 
* Xenbase is trying to develop a phenotype ontology (spoke with Troy Pell, developer)
 
** Asked about WPO and how we curate
 
* Lots of plant talks
 
* Many talks on performing quality checks on ontology development and ontology re-use
 
* Domain Informational Vocabulary Extraction (DIVE) tool
 
** Entity recognition/extraction
 
** Working with two plant journals
 
** Tries to identify co-occurrence patterns of words
 
** Web interface and curation tool
 
* Semantic similarity tools and evaluation of them
 
  
=== WormBase Phenotype Ontology working group ===
+
=== SObA Graphs ===
* Chris will send around Doodle poll
+
* New graphs now live on site (Expression, Gene Ontology, Human Diseases, Phenotypes)
* Goal is to discuss creation of logical definitions and alignment of phenotypes for Alliance
+
* A lot of whitespace padding above and below graph; maybe trim? trimming vertically would ultimately limit the view pane when user wants to zoom in, so we should leave as is for now
 +
* Diff tool: Raymond and Juancarlos created a prototype diff tool (for comparing two genes, for example)
 +
** Paul: compared two genes that should be very similar, but there are a lot of differences; may reflect annotation coverage rather than biology
  
  
== August 23, 2018 ==
+
== September 19, 2019 ==
  
=== Alliance tables ===
+
=== Strains ===
* Filtering/sorting priorities
+
* Need to wait for new strain IDs from Hinxton before running dumping scripts
* Open question about which tables on the Alliance website should be prioritized for acquiring sorting and filtering functionality
+
* Don't edit multi-ontology strain fields in OA for now!
 +
* Juancarlos will map free text and ontology-name strain entries to strain IDs once we have the complete mapping file
 +
* "Requested strain" field in Disease OA; not dumped, so don't need to worry about right now
  
=== Worm Phenotype Ontology working group ===
+
=== Alliance literature curation ===
* Gary S., Karen, Kimberly, and Chris have responded to [https://doodle.com/poll/xzkxet8sb57enver#table Doodle poll]
+
* Working group will be formed soon
* Looks like 12pm Pacific (3pm Eastern) on Thursdays is the time that works for everyone
+
* Will work out general common pipelines for literature curation
** May start late on days when WB CIT meeting goes past 12pm Pacific
 
** May want to start a bit past 12pm to allow west coasters to get lunch, etc.?
 
* Goals:
 
** Work on logical definitions for WPO terms
 
** Consider any restructuring of WPO that would facilitate ontology alignment with other MODs and UPheno
 
** Could we eventually create a phenotype annotation tool (and term requester) that allows modular expressions of a phenotype observation to lookup existing terms or create new terms with logical definitions based on those modular elements?
 
  
=== Alliance anatomy ===
+
=== SObA Graph relations ===
* Data quartermasters and expression working group are looking to get updated anatomy-Uberon mappings
+
* Currently only integrating over "is a", "part of" and "regulates"
* How frequent are data updates at the Alliance? Seems to be every ~2 months
+
* Maybe we could provide users an option to specify which relations to include, or maybe just exclude "regulates"
* Anatomy-Uberon mappings will affect phenotype ontology alignments
 
  
=== Automated Gene Descriptions ===
+
=== Author First Pass ===
* Working on using the anatomy ontology to perform logical trimming (as opposed to only using a file provided for neuronal term groupings provided by Oliver Hobert) for expression data summarizing
+
* Putting together paper for AFP
* Playing around with thresholds to see how the sentences look
+
* Reviewing all user input for paper
* Working on incorporating feedback from users; e.g. referring to human ortholog, protein domains, etc.
+
* Asking individual curators to check input
* Need to setup a communication between the gene description pipeline and the Postgres database
 
* Need to carefully consider the benefits/drawbacks of feeding gene description info back into Postgres/OA and vice versa
 

Revision as of 16:39, 19 September 2019

Previous Years

2009 Meetings

2011 Meetings

2012 Meetings

2013 Meetings

2014 Meetings

2015 Meetings

2016 Meetings

2017 Meetings

2018 Meetings


GoToMeeting link: https://www.gotomeet.me/wormbase1


2019 Meetings

January

February

March

April

May

June

July

August


September 12, 2019

Update on SVM pipeline

  • New SVM pipeline: more analysis and more parameter tuning
  • avoiding precision (and F-value) as a measure (dependent on ratio of positives and negatives in test set)
  • For example shown, "dumb" machine starts out with precision above 0.6
  • G-value (Michael's invention); does not depend on distribution of sets
  • Applied to various data types
  • Analysis: 10-fold cross validation
    • Randomly select 10% pos and neg (without replacement) and repeat until all papers sampled
  • F-value changes over different p/n values; G-value does not (essentially flat)
  • Area Under the Curve (AUC): probability that a random positive scores higher than random negative
  • AUC values for many WB data types upper 80%'s into 90%'s
  • Ranjana: How many papers for a good training set? Michael: we don't know yet
  • Can't reproduce old training sets (for old SVM); provide Michael better training sets if you want improved SVM
  • If SVM still not good enough, Michael will work on deep neural networks (Tensor Flow)
  • Michael can provide training sets he has used recently

Clarifying definitions of "defective" and "deficient" for phenotypes

  • WB phenotype ontology has many "variant/abnormal" terms and distinct subclass terms for "defective/deficient"
  • Have tried to create a logical definition pattern for these terms, but the vagueness of the meaning of "defective" and how it is distinct from "abnormal" has stalled the process
  • What do we mean exactly by "defective" and how, specifically, is this distinct from "abnormal"?
  • Definitions include meanings or words:
    • "Variations in the ability"
    • "aberrant"
    • "defect"
    • "defective"
    • "defects"
    • "deficiency"
    • "deficient"
    • "disrupted"
    • "impaired"
    • "incompetent"
    • "ineffective"
    • "perturbation that disrupts"
    • Failure to execute the characteristic response = abnormal?
    • abnormal
    • abnormality leading to specific outcomes
    • fail to exhibit the same taxis behavior = abnormal?
    • failure
    • failure OR delayed
    • failure, slower OR late
    • failure/abnormal
    • reduced
    • slower

Citace upload

    • Tuesday, Sep 24th

Strain to ID mapping

  • Waiting on Hinxton to send strain ID mapping file?
  • Hopefully we can all get that well before the upload deadline
  • Will do global replacement at time of citace upload (at least for now)

New name server

  • When will this officially go live?
  • Will we now be able to request strain IDs through the server? Yes

SObA Graphs

  • New graphs now live on site (Expression, Gene Ontology, Human Diseases, Phenotypes)
  • A lot of whitespace padding above and below graph; maybe trim? trimming vertically would ultimately limit the view pane when user wants to zoom in, so we should leave as is for now
  • Diff tool: Raymond and Juancarlos created a prototype diff tool (for comparing two genes, for example)
    • Paul: compared two genes that should be very similar, but there are a lot of differences; may reflect annotation coverage rather than biology


September 19, 2019

Strains

  • Need to wait for new strain IDs from Hinxton before running dumping scripts
  • Don't edit multi-ontology strain fields in OA for now!
  • Juancarlos will map free text and ontology-name strain entries to strain IDs once we have the complete mapping file
  • "Requested strain" field in Disease OA; not dumped, so don't need to worry about right now

Alliance literature curation

  • Working group will be formed soon
  • Will work out general common pipelines for literature curation

SObA Graph relations

  • Currently only integrating over "is a", "part of" and "regulates"
  • Maybe we could provide users an option to specify which relations to include, or maybe just exclude "regulates"

Author First Pass

  • Putting together paper for AFP
  • Reviewing all user input for paper
  • Asking individual curators to check input