Difference between revisions of "WormBase-Caltech Weekly Calls"

From WormBaseWiki
Jump to navigationJump to search
 
(567 intermediate revisions by 11 users not shown)
Line 21: Line 21:
 
[[WormBase-Caltech_Weekly_Calls_2019|2019 Meetings]]
 
[[WormBase-Caltech_Weekly_Calls_2019|2019 Meetings]]
  
 +
[[WormBase-Caltech_Weekly_Calls_2020|2020 Meetings]]
  
GoToMeeting link: https://www.gotomeet.me/wormbase1
+
= 2021 Meetings =
  
= 2020 Meetings =
+
[[WormBase-Caltech_Weekly_Calls_January_2021|January]]
  
== January 9, 2020 ==
+
[[WormBase-Caltech_Weekly_Calls_February_2021|February]]
  
=== Phenotype Curation Requests ===
+
[[WormBase-Caltech_Weekly_Calls_March_2021|March]]
* 1,229 emails sent Dec 3-6, 2019
 
* Received 194 annotations from 40 papers and from 37 distinct community curators
 
** 37 papers requested, 3 additional papers annotated
 
** 104 Phenotype OA annotations (from 27 papers; 25 distinct curators)
 
** 90 RNAi OA annotations (from 20 papers; 19 distinct curators)
 
* 43 bounced emails
 
** 2 resent to new addresses
 
** 5 have backup email addresses (also sent)
 
  
=== Worm Area Meetings ===
 
* Chris has (re)requested slots for WormBase for the Worcester Area Worm Meeting and the Boston Area Worm Meeting
 
* Will update group if/when a slot is assigned (probably not until Fall 2020 at the earliest)
 
  
=== Reference widget Textpresso linkouts ===
+
== April 1, 2021 ==
* Now live on WormBase, WS274
 
* [https://github.com/WormBase/website/issues/7347 GitHub ticket]
 
* Applies to the following classes: genes, strains, variations, transgenes, constructs, anatomy terms, clones, life stages, rearrangements, molecules, processes
 
* Gene example: https://wormbase.org/species/c_elegans/gene/WBGene00022861#0d--10
 
* Strain example: https://wormbase.org/species/c_elegans/strain/WBStrain00004309#05--10
 
* Variation example: https://wormbase.org/species/c_elegans/variation/WBVar00248884#08--10
 
* Transgene example: https://wormbase.org/species/all/transgene/WBTransgene00004654#04--10
 
** Known issue: searching on synonyms in addition to public name; Sibyl will fix
 
* Construct example: https://wormbase.org/species/all/construct/WBCnstr00023113#03--10
 
** Known issue: not working now; need to only search on public name when available, not on summary; Sibyl will fix
 
* Anatomy term example: https://wormbase.org/species/all/anatomy_term/WBbt:0005772#05--10
 
** Known challenge: "Psub1" will essentially never match the intended target and "P1" may find the embryonic cell or the postembryonic cell
 
* Clone example: https://wormbase.org/species/c_elegans/clone/W02C12#03--10
 
* Life stage example: https://wormbase.org/species/all/life_stage/WBls:0000038#03--10
 
** Known challenge: "L4 larva Ce" will never match; "L4 larva" maybe; but "L4" alone will not unless a synonym
 
* Rearrangement example: https://wormbase.org/species/all/rearrangement/sDp3#03--10
 
* Molecule example: https://wormbase.org/resources/molecule/WBMol:00003650#03--10
 
* Process examples:
 
** https://wormbase.org/resources/wbprocess/WBbiopr:00000001#09--10
 
** https://wormbase.org/resources/wbprocess/WBbiopr:00000079#09--10
 
* Michael has improved phrase search and combined supplemental documents with main paper documents; should roll out soon
 
  
=== WS276 Citace upload ===
+
=== Antibodies ===
* Hinxton upload Jan 31, 2020
+
* Alignment of the antibody class to Alliance:
* Citace upload on Tuesday, Jan 28, 2020
+
** Propose to move possible_pseudonym (192) and Other_animal (37) to remarks. Those tags are not currently used for curation.
 +
*** Other animal is sometimes used for older annotations, e.g. authors say that the antibodies were raised both  in rats and rabbits. Standard practice would create 2 records, one for the rat antibody and one for the rabbit.
 +
*** Possible pseudonym was used when  a curator was not able to unambiguously assign a previous antibody to a record. (we have a Other name -synonym- tag to capture unambiguous ones). When moving to remarks we can keep a controlled vocabulary for easy future parsing, e.g. “possible_pseudonym:”
 +
** Antigen field: currently separated into Protein, peptide, and other_antigen (e.g.: homogenate of early C.elegans embryos, sperm). Propose to use just one antigen field to capture antigen info.
  
=== Author First Pass paper ===
+
All changes proposed above were approved by the group
* AFP resent to Database
 
* Automated descriptions about to be sent
 
* SObA, write for micropub? One micropub on SObA and another on comparative SObA
 
  
=== Noctua/GO-CAM ===
+
=== textpress-dev clean up ===
* New version of the Noctua form released next week
+
* Michael has asked curators to assess what they have on textpresso-dev as it will not be around forever :-(
* Imports from WormBase?
+
* is it okay to transfer data and files we want to keep to tazendra? and then to our own individual machines?
** Big push in coming months will be to pull in all manual annotations from WB into Noctua (on track)
+
* Direct access may be possible via Caltech VPN
** Need to work on annotation history on back end
+
* Do we want to move content to AWS? May be complicated; it is still easy and cheap to maintain local file systems/machines
** May have face-to-face meeting in Pasadena
 
  
=== Variation curation ===
+
=== Braun servers ===
* Have a backlog; Paul D is assigned but has been overwhelmed
+
* 3 servers stored in Braun server room; is there a new contact person for accessing these servers?
* Have asserted this as a priority
+
* Mike Miranda replacement just getting settled; Paul will find out who is managing the server room and let Raymond know
* We have the allele-sequence form; where does it go? Hinxton
 
* Need to get allele/variation data in an Alliance-submission friendly form and pull it into the Alliance
 
* Need to integrate curation with the Variant Effect Predictor (VEP) pipeline
 
  
=== Topic meetings ===
+
=== Citace upload ===
* Asia (Taipei) meeting, Paul S going
+
* Next Friday, April 9th, by end of the day
* Aging meeting, Wen could go? (Wen: I can ask if they provide a timeslot for oral presentation.)
+
* Wen will contact Paul Davis for the frozen WS280 models file
* TAGC in April, Chris going
 
  
  
== January 16, 2020 ==
+
== April 8, 2021 ==
  
=== Variation names ===
+
=== Braun server outage ===
* Daniela entered a new allele name (tkTi1) in the temporary allele form CGI but it prompted an error: tkTi1 does not match 1 or 2 sets of 1-3 letters and 1-6 digits
.
+
* Raymond fixed; now Spica, wobr and wobr2 are back up
* Daniela asked Juancarlos to modify the temporary variation ID form to allow up to 4 letters instead of 3.
 
* Form here: http://tazendra.caltech.edu/~azurebrd/cgi-bin/forms/generic.cgi?action=TempVariationObo
 
* From the nomenclature guidelines: Newly generated Transposon insertions, especially those located in apparently intergenic regions, may also be given Ti (transposon insertion) names. These consist of the designation identifying the laboratory of origin, the two letters Ti, and a number, all italicized. Example: eTi13 is an insertion of a Mos transposon into an intergenic region on LGIII.
 
* We will wait for Paul D/Tim response and act accordingly
 
* for now the CGI has been changed to allow 4 letters, we will revert if need be
 
  
=== Webinars ===
+
=== Textpresso API ===
* During an AFP call we discussed the possibility to have webinars for authors to guide them through the form.
+
* Was down yesterday affecting WormiCloud; Michael has fixed
* Is having a webinar series something WB is interested in doing?
+
* Valerio will learn how to manage the API for the future
** we will start with an AFP/micropub webinar and will take it from there based on interest and attendance
 
  
 +
=== Grant opportunities ===
 +
* Possibilities to apply for supplements
 +
* May 15th deadline
 +
* Druggable genome project
 +
** Pharos: https://pharos.nih.gov/
 +
** could we contribute?
 +
* Visualization, tools, etc.
 +
* Automated person descriptions?
 +
* Automated descriptions for proteins, ion channels, druggable targets, etc.?
  
 +
=== New WS280 ONTOLOGY FTP directory ===
 +
* Changes requested here: https://github.com/WormBase/website/issues/7900
 +
* Here's the FTP URL: ftp://ftp.wormbase.org/pub/wormbase/releases/WS280/ONTOLOGY/
 +
* Known issues (Chris will report):
 +
** Ontology files are provided as ".gaf" in addition to ".obo"; we need to remove the ".gaf" OBO files
 +
** Some files are duplicated and/or have inappropriate file extensions
  
== January 23, 2020 ==
+
=== Odd characters in Postgres ===
 +
* Daniela and Juancarlos discovered some errors with respect to special characters pasted into the OA
 +
* Daniela would like to automatically pull in micropublication text (e.g. figure captions) into Postgres
 +
* We would need an automated way to convert special characters, like degree symbols ° into html unicode \&deg\;
 +
* Juancarlos and Valerio will look into possibly switching from a Perl module to a Python module to handle special characters
  
=== WS276 Citace upload ===
 
* Next Tuesday, Jan 28 10am Pacific
 
  
=== Extracellular/secreted proteins list ===
+
== April 15, 2021 ==
* Peter Roy looking for a list of C. elegans genes whose protein products are secreted
+
 
* Chris pointed him to BioMart search for SignalP and transmembrane proteins, and to the GO term page for "extracellular region" but Peter doesn't think that's exhaustive enough
+
=== Special characters in Postgres/OA ===
* Does anyone have any other suggestions or know of an empirical data set?
+
* Juancarlos working on/proposing a plan to store UTF-8 characters in Postgres and the OA which would then get converted, at dumping, to HTML entities (e.g. α) for the ACE files
* A survey of putative secreted and transmembrane proteins encoded in the C. elegans genome: https://www.ncbi.nlm.nih.gov/pubmed/22823938
+
* There is still a bit of cleanup needed to fix or remove special characters (not necessarily UTF-8) that apparently got munged upon copy/pasting into the OA in the past
*PF00188 Cysteine-rich secretory protein family Pfam
+
* Note: copy/paste from a PDF often works fine, but sometimes does not work as expected so manual intervention would be needed (e.g. entering Greek characters by hand in UTF-8 format)
This is a large family of cysteine-rich secretory proteins, antigen 5, and pathogenesis-related 1 proteins (CAP) that are found in a wide range of organisms, including prokaryotes [PMID:12625841]
+
* Would copy/pasting from HTML be better than PDF?
 +
* For Person curation it would be good to be able to faithfully store and display appropriate foreign characters (e.g. Chinese characters, Danish characters, etc.)
 +
* Mangolassi script called "get_summary_characters.pl" located here: /home/postgres/work/pgpopulation/grg_generegulation/20200618_summary_characters
 +
** Juancarlos will modify script to take a data type code as an argument on the command line and return all Postgres tables (and their respective PGIDs) that have special characters, e.g.
 +
*** $ ./get_summary_characters.pl exp
 +
*** $ ./get_summary_characters.pl int
 +
*** $ ./get_summary_characters.pl grg
 +
** or could pass just the datatype + field (postgres table). e.g.
 +
*** $ ./get_summary_characters.pl pic_description
 +
** Juancarlos will email everyone once it's ready.  It's ready, email sent.  Script is at /home/postgres/work/pgpopulation/oa_general/20210411_unicode_html/get_summary_characters.pl  Symlink this to your directory and run it from there, it will create files in the directory you are at when running it.
 +
* Action items:
 +
** Juancarlos will update the "get_summary_characters.pl" script as described above
 +
** Curators should use the "get_summary_characters.pl" to look for (potentially) bad characters in their OAs/Postgres tables
 +
** Need to perform bulk (automated) replacement of existing HTML entities into corresponding UTF-8 characters
 +
** Curators will need to work with Juancarlos for each OA to modify the dumper
 +
** Juancarlos will write (or append to existing) Postgres/OA dumping scripts to:
 +
*** 1) Convert UTF-8 characters to HTML entities in ACE files
 +
*** 2) Convert special quote and hyphen characters into simple versions that don't need special handling
 +
 
 +
=== CeNGEN pictures ===
 +
* Model change went in to accommodate images from the CeNGEN project
 +
* Want gene page images for CeNGEN data; have the specifications for such images been worked out? Maybe not yet
 +
* Raymond and Daniela will work with data producers to acquire images when ready
 +
 
 +
=== Supplement opportunities ===
 +
* Money available for software development to "harden" existing software
 +
* Might be possible to make Eduardo's single cell analysis tools more sustainable
 +
* Could make WormiCloud adapted to Alliance?
 +
* Put Noctua on more stable production footing? (GO cannot apply as they are in final year of existing grant)
 +
 
 +
=== Student project for Textpresso ===
 +
* Create tool to allow user to submit text and return a list of similar papers
 +
* Use cases:
 +
** curator wants an alert to find papers similar to what they've curated
 +
** look for potential reviewers of a paper based on similar text content

Latest revision as of 19:34, 15 April 2021

Previous Years

2009 Meetings

2011 Meetings

2012 Meetings

2013 Meetings

2014 Meetings

2015 Meetings

2016 Meetings

2017 Meetings

2018 Meetings

2019 Meetings

2020 Meetings

2021 Meetings

January

February

March


April 1, 2021

Antibodies

  • Alignment of the antibody class to Alliance:
    • Propose to move possible_pseudonym (192) and Other_animal (37) to remarks. Those tags are not currently used for curation.
      • Other animal is sometimes used for older annotations, e.g. authors say that the antibodies were raised both in rats and rabbits. Standard practice would create 2 records, one for the rat antibody and one for the rabbit.
      • Possible pseudonym was used when a curator was not able to unambiguously assign a previous antibody to a record. (we have a Other name -synonym- tag to capture unambiguous ones). When moving to remarks we can keep a controlled vocabulary for easy future parsing, e.g. “possible_pseudonym:”
    • Antigen field: currently separated into Protein, peptide, and other_antigen (e.g.: homogenate of early C.elegans embryos, sperm). Propose to use just one antigen field to capture antigen info.

All changes proposed above were approved by the group

textpress-dev clean up

  • Michael has asked curators to assess what they have on textpresso-dev as it will not be around forever :-(
  • is it okay to transfer data and files we want to keep to tazendra? and then to our own individual machines?
  • Direct access may be possible via Caltech VPN
  • Do we want to move content to AWS? May be complicated; it is still easy and cheap to maintain local file systems/machines

Braun servers

  • 3 servers stored in Braun server room; is there a new contact person for accessing these servers?
  • Mike Miranda replacement just getting settled; Paul will find out who is managing the server room and let Raymond know

Citace upload

  • Next Friday, April 9th, by end of the day
  • Wen will contact Paul Davis for the frozen WS280 models file


April 8, 2021

Braun server outage

  • Raymond fixed; now Spica, wobr and wobr2 are back up

Textpresso API

  • Was down yesterday affecting WormiCloud; Michael has fixed
  • Valerio will learn how to manage the API for the future

Grant opportunities

  • Possibilities to apply for supplements
  • May 15th deadline
  • Druggable genome project
  • Visualization, tools, etc.
  • Automated person descriptions?
  • Automated descriptions for proteins, ion channels, druggable targets, etc.?

New WS280 ONTOLOGY FTP directory

Odd characters in Postgres

  • Daniela and Juancarlos discovered some errors with respect to special characters pasted into the OA
  • Daniela would like to automatically pull in micropublication text (e.g. figure captions) into Postgres
  • We would need an automated way to convert special characters, like degree symbols ° into html unicode \&deg\;
  • Juancarlos and Valerio will look into possibly switching from a Perl module to a Python module to handle special characters


April 15, 2021

Special characters in Postgres/OA

  • Juancarlos working on/proposing a plan to store UTF-8 characters in Postgres and the OA which would then get converted, at dumping, to HTML entities (e.g. α) for the ACE files
  • There is still a bit of cleanup needed to fix or remove special characters (not necessarily UTF-8) that apparently got munged upon copy/pasting into the OA in the past
  • Note: copy/paste from a PDF often works fine, but sometimes does not work as expected so manual intervention would be needed (e.g. entering Greek characters by hand in UTF-8 format)
  • Would copy/pasting from HTML be better than PDF?
  • For Person curation it would be good to be able to faithfully store and display appropriate foreign characters (e.g. Chinese characters, Danish characters, etc.)
  • Mangolassi script called "get_summary_characters.pl" located here: /home/postgres/work/pgpopulation/grg_generegulation/20200618_summary_characters
    • Juancarlos will modify script to take a data type code as an argument on the command line and return all Postgres tables (and their respective PGIDs) that have special characters, e.g.
      • $ ./get_summary_characters.pl exp
      • $ ./get_summary_characters.pl int
      • $ ./get_summary_characters.pl grg
    • or could pass just the datatype + field (postgres table). e.g.
      • $ ./get_summary_characters.pl pic_description
    • Juancarlos will email everyone once it's ready. It's ready, email sent. Script is at /home/postgres/work/pgpopulation/oa_general/20210411_unicode_html/get_summary_characters.pl Symlink this to your directory and run it from there, it will create files in the directory you are at when running it.
  • Action items:
    • Juancarlos will update the "get_summary_characters.pl" script as described above
    • Curators should use the "get_summary_characters.pl" to look for (potentially) bad characters in their OAs/Postgres tables
    • Need to perform bulk (automated) replacement of existing HTML entities into corresponding UTF-8 characters
    • Curators will need to work with Juancarlos for each OA to modify the dumper
    • Juancarlos will write (or append to existing) Postgres/OA dumping scripts to:
      • 1) Convert UTF-8 characters to HTML entities in ACE files
      • 2) Convert special quote and hyphen characters into simple versions that don't need special handling

CeNGEN pictures

  • Model change went in to accommodate images from the CeNGEN project
  • Want gene page images for CeNGEN data; have the specifications for such images been worked out? Maybe not yet
  • Raymond and Daniela will work with data producers to acquire images when ready

Supplement opportunities

  • Money available for software development to "harden" existing software
  • Might be possible to make Eduardo's single cell analysis tools more sustainable
  • Could make WormiCloud adapted to Alliance?
  • Put Noctua on more stable production footing? (GO cannot apply as they are in final year of existing grant)

Student project for Textpresso

  • Create tool to allow user to submit text and return a list of similar papers
  • Use cases:
    • curator wants an alert to find papers similar to what they've curated
    • look for potential reviewers of a paper based on similar text content