Updating Ontology Collections

From TheGPMWiki
(Difference between revisions)
Jump to: navigation, search
(Created page with 'The contents of the files viewable through http://gpmdb.thegpm.org/go/index.html can be both refreshed and updated on a [[Local_GPM_Installation_Instructions|standard installati…')
Line 16: Line 16:
==Scripts==
==Scripts==
-
The scripts that update the various ontologies are available in the <tt>/thegpm/scripts/ont_builder/</tt>  
+
The scripts that update the various ontologies are available in <tt>/thegpm/scripts/ont_builder/</tt>.
-
folder on a standard installation of the GPM's software. Some manual editing  
+
Some manual editing of the scripts must currently be done to either update or refresh the gene ontology pages.
-
of the scripts must currently be done to either update or refresh the gene ontology pages.
+
The scripts that perform the refreshing and updating work are:
The scripts that perform the refreshing and updating work are:
Line 39: Line 38:
Download a tab-delimited file for any of the species to be updated. The  
Download a tab-delimited file for any of the species to be updated. The  
column order for the data files for updating the GO category displays is as follows:
column order for the data files for updating the GO category displays is as follows:
-
*Ensembl Protein Identifier
+
*Ensembl Protein ID
-
*GO Group Name
+
*GO Term Accession (bp)
-
*GO Group Name (mf)
+
*GO Term Accession (cc)
-
*GO Group Name (cc)
+
*GO Term Accession (mf)
The GO Group fields can be in any order, but the protein identifier must be  
The GO Group fields can be in any order, but the protein identifier must be  
Line 51: Line 50:
column order for the data files for updating the chromosome displays is as follows:
column order for the data files for updating the chromosome displays is as follows:
*Chromosome Name
*Chromosome Name
-
*Start position (bp)
+
*Gene start (bp)
-
*Ensembl Protein Identifier
+
*Ensembl Protein ID
Any subsequent fields will be ignored.
Any subsequent fields will be ignored.
Line 66: Line 65:
===Chromosomes===
===Chromosomes===
-
====script editing====
+
====Human====
 +
#Edit the script '''ont_builder_update_chromosome_proteins.pl'''. The value of the substitution found below the line marked "EDIT BELOW" must be ENSP.
 +
#Run the script as <tt>perl ont_builder_update_chromosome_proteins.pl <nowiki>[source file]</nowiki> HS</tt> where <nowiki>[source file]</nowiki> is the path and name of the tab-delimited file from ENSEMBL.
-
====human====
+
====Mouse====
-
 
+
#Edit the script '''ont_builder_update_chromosome_proteins.pl'''. The value of the substitution found below the line marked "EDIT BELOW" must be ENSMUSP.
-
====mouse====
+
#Run the script as <tt>perl ont_builder_update_chromosome_proteins.pl <nowiki>[source file]</nowiki> MM</tt> where <nowiki>[source file]</nowiki> is the path and name of the tab-delimited file from ENSEMBL.
===GO categories===
===GO categories===
-
====script editing====
+
====Human====
-
 
+
#Run the script <tt>ont_builder_update_go_proteins.pl <nowiki>[source file]</nowiki> HS</tt> where <nowiki>[source file]</nowiki> is the path and name of the tab-delimited file from ENSEMBL.
-
====human====
+
-
====mouse====
+
====Mouse====
 +
#Run the script <tt>ont_builder_update_go_proteins.pl <nowiki>[source file]</nowiki> MM</tt> where <nowiki>[source file]</nowiki> is the path and name of the tab-delimited file from ENSEMBL.
-
====yeast====
+
====Yeast====
 +
#Run the script <tt>ont_builder_update_go_proteins.pl <nowiki>[source file]</nowiki> SC</tt> where <nowiki>[source file]</nowiki> is the path and name of the tab-delimited file from ENSEMBL.
==Refreshing ontology content==
==Refreshing ontology content==

Revision as of 22:24, 25 January 2011

The contents of the files viewable through http://gpmdb.thegpm.org/go/index.html can be both refreshed and updated on a standard installation of the GPM. Below is a set of directions on how to refresh the existing files, how to obtain new data and how to update ontologies with the new proteins.

The display information is stored in /thegpm/go/, and any refreshing of the information will result in new versions of the files available in that directory being created.

The source files for the lists of proteins in a given ontology are stored in /thegpm/scripts/ont_builder/ and three subfolders:

  • /thegpm/scripts/ont_builder/human_go/
  • /thegpm/scripts/ont_builder/mouse_go/
  • /thegpm/scripts/ont_builder/yeast_go/

Contents

Scripts

The scripts that update the various ontologies are available in /thegpm/scripts/ont_builder/. Some manual editing of the scripts must currently be done to either update or refresh the gene ontology pages.

The scripts that perform the refreshing and updating work are:

  • ont_builder.pl: performs the actual creation of display files.
  • ont_builder_batch.pl: creates a list of files and calls ont_builder.pl on each of them.
  • ont_builder_update_chromosome_proteins.pl: updates the chromosome-based ontology of proteins for both human and mouse.
  • ont_builder_update_go_proteins.pl: updates the gene-based ontology of proteins for human, mouse and yeast.
  • ont_builder_update_go_details.pl: updates the file containing the identified vs. total proteins counts for each species, in each gene ontology.

Getting data files

Data files for both chromosome and GO ontologies are downloaded from BioMart on the ENSEMBL website. Use the most recent Ensembl release, and then choose the appropriate species below.

Data files for the BTO ontologies are generated separately. The source protein lists are generated periodically through the Normal Clinical Tissue Alliance and updated at that time.

GO data files

Download a tab-delimited file for any of the species to be updated. The column order for the data files for updating the GO category displays is as follows:

  • Ensembl Protein ID
  • GO Term Accession (bp)
  • GO Term Accession (cc)
  • GO Term Accession (mf)

The GO Group fields can be in any order, but the protein identifier must be first. Any subsequent fields will be ignored.

Chromosome data files

Download a tab-delimited file for any of the species to be updated. The column order for the data files for updating the chromosome displays is as follows:

  • Chromosome Name
  • Gene start (bp)
  • Ensembl Protein ID

Any subsequent fields will be ignored.

Updating ontology content

Updating the list of proteins associated with an ontology will modify the source XML files from which the display files are built. This step must be done first if there is new information available from Ensembl (e.g., after a new data release). However, if refreshing the best expect and identification counts for each protein in an ontology is all that is required, this step can be skipped.

Chromosomes

Human

  1. Edit the script ont_builder_update_chromosome_proteins.pl. The value of the substitution found below the line marked "EDIT BELOW" must be ENSP.
  2. Run the script as perl ont_builder_update_chromosome_proteins.pl [source file] HS where [source file] is the path and name of the tab-delimited file from ENSEMBL.

Mouse

  1. Edit the script ont_builder_update_chromosome_proteins.pl. The value of the substitution found below the line marked "EDIT BELOW" must be ENSMUSP.
  2. Run the script as perl ont_builder_update_chromosome_proteins.pl [source file] MM where [source file] is the path and name of the tab-delimited file from ENSEMBL.

GO categories

Human

  1. Run the script ont_builder_update_go_proteins.pl [source file] HS where [source file] is the path and name of the tab-delimited file from ENSEMBL.

Mouse

  1. Run the script ont_builder_update_go_proteins.pl [source file] MM where [source file] is the path and name of the tab-delimited file from ENSEMBL.

Yeast

  1. Run the script ont_builder_update_go_proteins.pl [source file] SC where [source file] is the path and name of the tab-delimited file from ENSEMBL.

Refreshing ontology content

Refreshing the content of an ontology will recalculate the identification counts and best expect scores for each of the proteins defined as belonging to the ontology in the source XML files.

Chromosomes

script editing

human

mouse

GO categories

script editing

human

mouse

yeast

Personal tools