45122
Comment:
|
47746
|
Deletions are marked like this. | Additions are marked like this. |
Line 8: | Line 8: |
. Last updated May 11 , 2012 | . Last updated May 16 , 2012 |
Line 36: | Line 36: |
== Software == The Software menu gives you access to the Interbull checking programs. By clicking on Software a drop down menu will open and you will be able to choose the type of checking program you are interested in, i.e. Pedigree, Proofs or GenoList. === Pedigree's Checking Programs === Two Pythons programs are available for checking pedigree, they are CheckPedigree.py and CheckLinks.py. Under Software|Pedigree you will find information on each of the programs together with the latest version of the program to download. Please note that the programs check their internal version with the value stored on the Interbull server. You will have to download the most recent version if there is a mismatch. This implies that you have to have access to an internet connection to be able to run the programs. |
|
Line 40: | Line 46: |
If you want to get pedigree information on a particular animal, click on ''Query'' menu link.The page that will open contains an ''Animal lookup'',by inserting an International ID in the ''Animal lookup'' and then clicking on ''Lookup!'' will show the information related to your query. The central part of the page will show the international ID of the animal you were interested, followed by its name, birth date and birth date status, animal status, date of last update and who performed the last update. A description of all possible birthdate and animal status are presented in Table 1. |
If you want to get pedigree information on a particular animal, click on ''Animal Query'' menu link.The page that will open contains an ''Animal lookup'',by inserting an International ID in the ''Animal lookup'' and then clicking on ''Lookup!'' will show the information related to your query. The central part of the page will show the international ID of the animal you were interested, followed by its name, birth date and birth date status, animal status, date of last update and who performed the last update. A description of all possible birthdate and animal status are presented in Table 1.''' ''' |
Line 56: | Line 62: |
Below the animal information, you will find a table listing all the animal's offspring together with their name and birth date. The table, by default, shows the first 200 offsprings associated to the aniaml ID. You can however modify the number of entries by clicking on the harrow beside "entries". Likewise, if you are only interested on a specific offspring, you can search for it by inserting its IID in the "''search''" space. Each header in the table is an active buttom, this means that by clicking on them you have the possibility to sort out the content of the table in the way that suits you better. | Below the animal information, you will find a table listing all animal's offspring together with their name and birth date. The table, by default, shows the first 200 offsprings associated to that particular animal ID. You can however modify the number of entries by clicking on the harrow beside "entries". Likewise, if you are only interested on a specific offspring, you can search for it by inserting its IID in the "''search''" space. Each header in the table is an active buttom, this means that by clicking on them you have the possibility to sort the content of the table in the way that suits you better. |
Line 62: | Line 68: |
{{{ADD PICTURE OF ANIMAL QUERY}}}} | '''{{{ ADD PICTURE OF ANIMAL QUERY}}} ''' |
Line 67: | Line 73: |
||First Reporting Organization ||The country-breed combination does not belong to this organization but it has been the first one uploading this record. ||Temporary, can modify pedigree information of a given animal as long as it is still unverified by its authoritative organization. || | ||First Reporting Organization ||The country-breed combination does not belong to this organization but it has been the first one uploading this record. ||Temporary authority, can modify pedigree information of a reported animal as long as it is still unverified by its authoritative organization. || |
Line 72: | Line 78: |
The ''Uploads'' menu link is set up for uploading of pedigree (file 200 or 601) and link (cross-reference, file202) files. You can find their format in APPENDIX I. The only files accepted are the zip files produced by the two checking programs: CheckPedigree.py and CheckLinks.py. Access to the programs and their instruction is via the ''Software'' menu link. Browse your file using the ''Browse'' buttom and upload it by clicking on ''Upload. '' |
The ''Uploads'' menu link is set up for uploading of pedigree and link (cross-reference) files. These files have to be created according to the format reported in APPENDIX I, file format 200 for dairy pedigree, file format 601 for beef pedigree and file format 202 for link files, valid for both dairy and beef. The content of your files needs to be checked by running two pythons programs: '''CheckPedigree.'''py and''' CheckLinks.'''py. If the programs find no errors in the format or in the content of your files than they will produce two zip files, IB-org_code-yyyymmddThhmmss.zip (containing the file200 or file601) and IB202-org_code-yyyymmddThhmmss.zip (containing the file202). These files are the only files that can be uploaded into IDEA, any other file will be rejected. After uploading, the same checks performed by the checking programs will be performed once again inside IDEA therefore any manipulation of the zip files would be useless as the files will get rejected. Access to the programs and their instruction is via the Software menu link. To upload your files, browse them using the Browse buttom and upload it by clicking on Upload. |
Line 80: | Line 88: |
Attached to the confirmation email you will find two files called "processed.txt" and "not_processed.txt". The "processed.txt" lists all the animals that have been inserted in the database and, eventually, other information such as: | Attached to the confirmation email you will find two files called "processed.txt" and "not_processed.txt". The "processed.txt" contains all animals that have been inserted in the database and, eventually, other information such as: |
Line 92: | Line 100: |
The creation of cross references in the database is made by uploading of a file202 (previously checked by CheckLinks.py). Two IDs will be always considered as two different animals until a proper file202 is uploaded. | The creation of cross references in the database is made by uploading of a IB202-org_code-yyyymmddThhmmss.zip (file202 previously checked by''' CheckLinks'''.py). Two IDs will be always considered as two different animals until a proper file202 is uploaded. |
Line 100: | Line 108: |
Please be advised that IDEA does not discern between international and national aliases or between valid or invalid aliases, as it solely relies on the international ID. In IDEA you can now submit cross-references for animals outside your authority. In this case the pair you are trying to link together will be treated as potential duplicates and listed in the corresponding authoritative organization's potential duplicates page, with your choice highlighted. |
Please be advised that IDEA does not discern between international and national aliases as it solely relies on the international ID. In IDEA you can now submit cross-references for animals outside your authority. In this case the pair you are trying to link together will be treated as potential duplicates and listed in the corresponding authoritative organization's potential duplicates page, with your choice highlighted.The linking will be performed only if the authoritative organization agrees with your choice. |
Line 107: | Line 115: |
AID1 and AID2 are according to the format of file202, therefore AID1=wrong/alias AID and AID2=international ID. In case of records that fit in the conditions for more than one case, the first case in the table takes precedence. ||<style="text-align:center" |2>'''Case''' ||||<style="text-align:center;font-weight:bold;">DB info^1^ ||||<style="text-align:center;font-weight:bold;">Authority^2^ ||<style="text-align:center;font-weight:bold;" |2>Other conditions ||<style="text-align:center;font-weight:bold;" |2>Actions during loading || |
AID1 and AID2 are according to the format of file202, therefore AID1=wrong/alias AID and AID2=international AID. In case of records that fit in the conditions for more than one case, the first case in the table takes precedence. ''' ||<style="text-align:center" |2>Case ''' ''' ||||<style="text-align:center;font-weight:bold;">DB info^1^ ||||<style="text-align:center;font-weight:bold;">Authority^2^ ||<style="text-align:center;font-weight:bold;" |2>Other conditions ||<style="text-align:center;font-weight:bold;" |2>Actions during loading || |
Line 130: | Line 138: |
||||||||||||||<style="text-align:center">2 'Full': authoritative organization; 'None': Not authoritative organization; 'Any': either authoritative organization or first reporting organization; || | ||||||||||||||<style="text-align:center">2 'Full': authoritative organization; 'None': Not authoritative organization; 'Any': either authoritative organization or first reporting organization;'-' Regardless || ''' |
Line 138: | Line 148: |
Please note that IDEA is based on a UTF-8 character encoding. It is recommended that all files entering IDEA would use a UTF-8 character encoding as well. |
|
Line 139: | Line 151: |
Only authoritative organization can modify the name of an animal. To do so simply upload a pedigree file with the new name information and the changes will be recorded in the database.''' ''' | Only authoritative organization or first reporting organization, while the record is till unverified, can modify the name of an animal. To do so simply upload a pedigree file with the new name information and the changes will be recorded in the database. ''' ''' |
Line 145: | Line 157: |
By clicking on'' __here__'' you will be directed into an ascii file following the format shown in Appendix IV. You can save the file by clicking on “File/Save As” in the tool bar.The ascii file contains a list of all animals as loaded by reporting countries and for which you appear as the authoritative organization. This means that only you have the right to say if the pedigree record is correct or not.''' ''' | By clicking on'' __here__'' you will be directed into an ascii file following the format shown in Appendix IV. You can save the file by clicking on “File/Save As” in the tool bar.The ascii file contains a list of all animals as loaded by reporting countries and for which you appear as the authoritative organization. This means that only you have the right to say if the pedigree record is correct or not. ''' ''' |
Line 148: | Line 160: |
For each animal listed in your “Request of Pedigree” file yhave to upload its pedigree information as it appears in your own database, using file format 200 and checkpedigree.pl.By doing so you are ''verifying ''the reported information as the system considers verified only the information provided by the authority organization. When you are verifying an animal record you might find yourself in front of four possible scenarios, below you find instructions on what to do for each of them.''' ''' '''Scenario 1''' |
For each animal listed in your “Request of Pedigree” file yhave to upload its pedigree information as it appears in your own database, using file format 200 and checkpedigree.pl.By doing so you are ''verifying ''the reported information as the system considers verified only the information provided by the authority organization. When you are verifying an animal record you might find yourself in front of four possible scenarios, below you find instructions on what to do for each of them. ''' ''' Scenario 1''' ''' |
Line 154: | Line 166: |
* Upload a pedigree file (file200 previously inspected by CheckPedigree.pl) as it appears in your own database, weather the reported pedigree information is correct or not. '''Scenario 2''' |
* Upload a pedigree file (file200 previously inspected by''' CheckPedigree'''.pl) as it appears in your own database, weather the reported pedigree information is correct or not. Scenario 2''' ''' |
Line 171: | Line 183: |
'''Scenario 3''' | Scenario 3''' ''' |
Line 181: | Line 193: |
USA uploads a file200 (checked by CheckPedigree.pl) for the animal BSWDEUM000803611398 '''Scenario 4''' |
USA uploads a file200 (checked by''' CheckPedigree'''.pl) for the animal BSWDEUM000803611398 Scenario 4''' ''' |
Line 197: | Line 209: |
You will have to upload your files using the uploading pedigree tool you find in the ''upload'' tab.''' ''' | You will have to upload your files using the uploading pedigree tool you find in the ''upload'' tab. ''' ''' |
Line 204: | Line 216: |
=== Look at the Limbo === | === Invalid IDs === |
Line 213: | Line 225: |
'''''Overview of verified/unverified animals submitted by your organization''''' | ''Overview of verified/unverified animals submitted by your organization''''' ''' |
Line 217: | Line 229: |
'''N.B. '''among all the animals in the “''animal''” field that you have uploaded, the ones having your country code in their international ID are considered validated by default because you are their authoritative organization, therefore there should not be any animals still pending validation by your country in this table. If this is not the case it means that there are some parents without an entry in the animal field and could not be validated because the validation procedure takes place in the animal field. To prevent this to happen, you will have to upload pedigree records for the animals and their parents as well. '''''Summary of animals waiting for verification by your organization''''' |
N.B. among all the animals in the “''animal''” field that you have uploaded, the ones having your country code in their international ID are considered validated by default because you are their authoritative organization, therefore there should not be any animals still pending validation by your country in this table. If this is not the case it means that there are some parents without an entry in the animal field and could not be validated because the validation procedure takes place in the animal field. To prevent this to happen, you will have to upload pedigree records for the animals and their parents as well. ''Summary of animals waiting for verification by your organization''''' ''' |
Line 224: | Line 236: |
Although your national pedigree file has been already checked by the CheckPedigree.pl for pedigree conflicts, there is the possibility that the international pedigree still shows some birthdays conflicts.To check for that click on ''Pedigree Conflicts'' bottom, you will be directed into a new page showing all conflicts where your organization is involved. Below is an explenation of the Pedigree Conflicts page content: | Although your national pedigree file has been already checked by the '''CheckPedigree.'''pl for pedigree conflicts, there is the possibility that the international pedigree still shows some birthdays conflicts.To check for that click on ''Pedigree Conflicts'' bottom, you will be directed into a new page showing all conflicts where your organization is involved. Below is an explenation of the Pedigree Conflicts page content: |
Line 240: | Line 252: |
* In case you do not know how to fix it you should contact Interbull Centre''' ''' | * In case you do not know how to fix it you should contact Interbull Centre ''' ''' |
Line 259: | Line 271: |
<<Include(public/Org_codes)>> | '''<<Include(public/Org_codes)>> ''' |
Line 263: | Line 275: |
||<width="96px" style="vertical-align:top">'''Starting position''' ||<width="277px" style="vertical-align:top">'''Field''' ||<width="115px" style="vertical-align:top">'''Format''' ||<width="127px" style="vertical-align:top">'''Example''' || | ||<width="96px" style="vertical-align:top">Starting position''' ''' ||<width="277px" style="vertical-align:top">Field''' ''' ||<width="115px" style="vertical-align:top">Format''' ''' ||<width="127px" style="vertical-align:top">Example''' ''' || |
Line 265: | Line 277: |
||<width="96px" style="vertical-align:top"> ||<width="277px" style="vertical-align:top">'''International ID of ANIMAL''' ||<width="115px" style="vertical-align:top"> ||<width="127px" style="vertical-align:top"> || | ||<width="96px" style="vertical-align:top"> ||<width="277px" style="vertical-align:top">International ID of ANIMAL''' ''' ||<width="115px" style="vertical-align:top"> ||<width="127px" style="vertical-align:top"> || |
Line 267: | Line 279: |
||<width="96px" style="vertical-align:top">8 ||<width="277px" style="vertical-align:top">Country of first registration of animal^3^ ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">CAN|| ||<width="96px" style="vertical-align:top">11 ||<width="277px" style="vertical-align:top">Sex ||<width="115px" style="vertical-align:top">character 1 ||<width="127px" style="vertical-align:top">M|| |
||<width="96px" style="vertical-align:top">8 ||<width="277px" style="vertical-align:top">Country of first registration of animal^3^ ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">CAN || ||<width="96px" style="vertical-align:top">11 ||<width="277px" style="vertical-align:top">Sex ||<width="115px" style="vertical-align:top">character 1 ||<width="127px" style="vertical-align:top">M || |
Line 271: | Line 283: |
||<width="96px" style="vertical-align:top"> ||<width="277px" style="vertical-align:top">'''International ID of Sire of ANIMAL''' ||<width="115px" style="vertical-align:top"> ||<width="127px" style="vertical-align:top"> || ||<width="96px" style="vertical-align:top">25 ||<width="277px" style="vertical-align:top">Breed of sire of animal ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">HOL|| ||<width="96px" style="vertical-align:top">28 ||<width="277px" style="vertical-align:top">Country of first registration of sire of animal^3^ ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">CAN|| ||<width="96px" style="vertical-align:top">31 ||<width="277px" style="vertical-align:top">Sex ||<width="115px" style="vertical-align:top">character 1 ||<width="127px" style="vertical-align:top">M|| ||<width="96px" style="vertical-align:top">32 ||<width="277px" style="vertical-align:top">ID number of sire of animal^4^ ||<width="115px" style="vertical-align:top">character 12 ||<width="127px" style="vertical-align:top">556912367589|| |
||<width="96px" style="vertical-align:top"> ||<width="277px" style="vertical-align:top">International ID of Sire of ANIMAL''' ''' ||<width="115px" style="vertical-align:top"> ||<width="127px" style="vertical-align:top"> || ||<width="96px" style="vertical-align:top">25 ||<width="277px" style="vertical-align:top">Breed of sire of animal ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">HOL || ||<width="96px" style="vertical-align:top">28 ||<width="277px" style="vertical-align:top">Country of first registration of sire of animal^3^ ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">CAN || ||<width="96px" style="vertical-align:top">31 ||<width="277px" style="vertical-align:top">Sex ||<width="115px" style="vertical-align:top">character 1 ||<width="127px" style="vertical-align:top">M || ||<width="96px" style="vertical-align:top">32 ||<width="277px" style="vertical-align:top">ID number of sire of animal^4^ ||<width="115px" style="vertical-align:top">character 12 ||<width="127px" style="vertical-align:top">556912367589 || |
Line 277: | Line 289: |
||<width="96px" style="vertical-align:top"> ||<width="277px" style="vertical-align:top">'''International ID of Dam of ANIMAL''' ||<width="115px" style="vertical-align:top"> ||<width="127px" style="vertical-align:top"> || ||<width="96px" style="vertical-align:top">45 ||<width="277px" style="vertical-align:top">Breed of dam of animal ^2^ ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">HOL|| ||<width="96px" style="vertical-align:top">48 ||<width="277px" style="vertical-align:top">Country of first registration of dam of animal^3^ ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">CAN|| ||<width="96px" style="vertical-align:top">51 ||<width="277px" style="vertical-align:top">Sex ||<width="115px" style="vertical-align:top">character 1 ||<width="127px" style="vertical-align:top">F|| ||<width="96px" style="vertical-align:top">52 ||<width="277px" style="vertical-align:top">ID number of dam of animal^4^ ||<width="115px" style="vertical-align:top">character 12 ||<width="127px" style="vertical-align:top">123569874521|| |
||<width="96px" style="vertical-align:top"> ||<width="277px" style="vertical-align:top">International ID of Dam of ANIMAL''' ''' ||<width="115px" style="vertical-align:top"> ||<width="127px" style="vertical-align:top"> || ||<width="96px" style="vertical-align:top">45 ||<width="277px" style="vertical-align:top">Breed of dam of animal ^2^ ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">HOL || ||<width="96px" style="vertical-align:top">48 ||<width="277px" style="vertical-align:top">Country of first registration of dam of animal^3^ ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">CAN || ||<width="96px" style="vertical-align:top">51 ||<width="277px" style="vertical-align:top">Sex ||<width="115px" style="vertical-align:top">character 1 ||<width="127px" style="vertical-align:top">F || ||<width="96px" style="vertical-align:top">52 ||<width="277px" style="vertical-align:top">ID number of dam of animal^4^ ||<width="115px" style="vertical-align:top">character 12 ||<width="127px" style="vertical-align:top">123569874521 || |
Line 283: | Line 295: |
||<width="96px" style="vertical-align:top">65 ||<width="277px" style="vertical-align:top">Birth date of animal (YYYYMMDD) ||<width="115px" style="vertical-align:top">integer 8 ||<width="127px" style="vertical-align:top">19870215|| | ||<width="96px" style="vertical-align:top">65 ||<width="277px" style="vertical-align:top">Birth date of animal (YYYYMMDD) ||<width="115px" style="vertical-align:top">integer 8 ||<width="127px" style="vertical-align:top">19870215 || |
Line 285: | Line 297: |
||<width="96px" style="vertical-align:top">77 ||<width="277px" style="vertical-align:top">Birth date of first AI daughters (YYYYMMDD) ||<width="115px" style="vertical-align:top">Integer 8 ||<width="127px" style="vertical-align:top">19890314|| ||<width="96px" style="vertical-align:top">86 ||<width="277px" style="vertical-align:top">Name of animal^6^ ||<width="115px" style="vertical-align:top">character 30 ||<width="127px" style="vertical-align:top">Cantarello|| |
||<width="96px" style="vertical-align:top">77 ||<width="277px" style="vertical-align:top">Birth date of first AI daughters (YYYYMMDD) ||<width="115px" style="vertical-align:top">Integer 8 ||<width="127px" style="vertical-align:top">19890314 || ||<width="96px" style="vertical-align:top">86 ||<width="277px" style="vertical-align:top">Name of animal^6^ ||<width="115px" style="vertical-align:top">character 30 ||<width="127px" style="vertical-align:top">Cantarello || |
Line 288: | Line 300: |
||<width="96px" style="vertical-align:top"> ||<width="277px" style="vertical-align:top">'''National ID of ANIMAL''' ||<width="115px" style="vertical-align:top"> ||<width="127px" style="vertical-align:top"> || ||<width="96px" style="vertical-align:top">117 ||<width="277px" style="vertical-align:top">Breed of animal^2^ ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">HOL|| ||<width="96px" style="vertical-align:top">120 ||<width="277px" style="vertical-align:top">Country ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">CAN|| ||<width="96px" style="vertical-align:top">123 ||<width="277px" style="vertical-align:top">Sex ||<width="115px" style="vertical-align:top">character 1 ||<width="127px" style="vertical-align:top">M|| ||<width="96px" style="vertical-align:top">124 ||<width="277px" style="vertical-align:top">ID number of animal^4^ ||<width="115px" style="vertical-align:top">character 12 ||<width="127px" style="vertical-align:top">000000A12345|| |
||<width="96px" style="vertical-align:top"> ||<width="277px" style="vertical-align:top">National ID of ANIMAL''' ''' ||<width="115px" style="vertical-align:top"> ||<width="127px" style="vertical-align:top"> || ||<width="96px" style="vertical-align:top">117 ||<width="277px" style="vertical-align:top">Breed of animal^2^ ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">HOL || ||<width="96px" style="vertical-align:top">120 ||<width="277px" style="vertical-align:top">Country ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">CAN || ||<width="96px" style="vertical-align:top">123 ||<width="277px" style="vertical-align:top">Sex ||<width="115px" style="vertical-align:top">character 1 ||<width="127px" style="vertical-align:top">M || ||<width="96px" style="vertical-align:top">124 ||<width="277px" style="vertical-align:top">ID number of animal^4^ ||<width="115px" style="vertical-align:top">character 12 ||<width="127px" style="vertical-align:top">000000A12345 || |
Line 294: | Line 306: |
||<width="96px" style="vertical-align:top">137 ||<width="277px" style="vertical-align:top">Country sending information ||<width="115px" style="vertical-align:top">character 3 ||<width="127px" style="vertical-align:top">CAN|| | ||<width="96px" style="vertical-align:top; ">137 ||<width="277px" style="vertical-align:top; ">Country sending information ||<width="115px" style="vertical-align:top; ">character 3 ||<width="127px" style="vertical-align:top; ">CAN || ||||||||<width="96px" style="vertical-align:top;text-align:center">Character encoding: UTF-8 || |
Line 298: | Line 311: |
||||||||<tablestyle="text-align:left"width="508px" style="text-align:center;vertical-align:top">'''File Format for Pedigree Delivery to the Interbull Centre for Interbeef Evaluation''' || ||<width="79px" style="vertical-align:top">'''Starting position''' ||<width="229px" style="vertical-align:top">'''Field''' ||<width="95px" style="vertical-align:top">'''Format''' ||<width="105px" style="vertical-align:top">'''Example''' || |
||||||||<tablestyle="text-align:left"width="508px" style="text-align:center;vertical-align:top">File Format for Pedigree Delivery to the Interbull Centre for Interbeef Evaluation''' ''' || ||<width="79px" style="vertical-align:top">Starting position''' ''' ||<width="229px" style="vertical-align:top">Field''' ''' ||<width="95px" style="vertical-align:top">Format''' ''' ||<width="105px" style="vertical-align:top">Example''' ''' || |
Line 301: | Line 314: |
||<width="79px" style="vertical-align:top"> ||<width="229px" style="vertical-align:top">'''International ID of ANIMAL''' ||<width="95px" style="vertical-align:top"> ||<width="105px" style="vertical-align:top"> || | ||<width="79px" style="vertical-align:top"> ||<width="229px" style="vertical-align:top">International ID of ANIMAL''' ''' ||<width="95px" style="vertical-align:top"> ||<width="105px" style="vertical-align:top"> || |
Line 303: | Line 316: |
||<width="79px" style="vertical-align:top">8 ||<width="229px" style="vertical-align:top">Country of first registration of animal^3^ ||<width="95px" style="vertical-align:top">character 3 ||<width="105px" style="vertical-align:top">DNK|| ||<width="79px" style="vertical-align:top">11 ||<width="229px" style="vertical-align:top">Sex ||<width="95px" style="vertical-align:top">character 1 ||<width="105px" style="vertical-align:top">F|| |
||<width="79px" style="vertical-align:top">8 ||<width="229px" style="vertical-align:top">Country of first registration of animal^3^ ||<width="95px" style="vertical-align:top">character 3 ||<width="105px" style="vertical-align:top">DNK || ||<width="79px" style="vertical-align:top">11 ||<width="229px" style="vertical-align:top">Sex ||<width="95px" style="vertical-align:top">character 1 ||<width="105px" style="vertical-align:top">F || |
Line 307: | Line 320: |
||<width="79px" style="vertical-align:top"> ||<width="229px" style="vertical-align:top">'''International ID of Sire of ANIMAL''' ||<width="95px" style="vertical-align:top"> ||<width="105px" style="vertical-align:top"> || ||<width="79px" style="vertical-align:top">25 ||<width="229px" style="vertical-align:top">Breed of sire of animal ^2^ ||<width="95px" style="vertical-align:top">character 3 ||<width="105px" style="vertical-align:top">CHA|| ||<width="79px" style="vertical-align:top">28 ||<width="229px" style="vertical-align:top">Country of first registration of sire of animal^3^ ||<width="95px" style="vertical-align:top">character 3 ||<width="105px" style="vertical-align:top">DNK|| ||<width="79px" style="vertical-align:top">31 ||<width="229px" style="vertical-align:top">Sex ||<width="95px" style="vertical-align:top">character 1 ||<width="105px" style="vertical-align:top">M|| ||<width="79px" style="vertical-align:top">32 ||<width="229px" style="vertical-align:top">ID number of sire of animal^4^ ||<width="95px" style="vertical-align:top">character 12 ||<width="105px" style="vertical-align:top">654789321852|| |
||<width="79px" style="vertical-align:top"> ||<width="229px" style="vertical-align:top">International ID of Sire of ANIMAL''' ''' ||<width="95px" style="vertical-align:top"> ||<width="105px" style="vertical-align:top"> || ||<width="79px" style="vertical-align:top">25 ||<width="229px" style="vertical-align:top">Breed of sire of animal ^2^ ||<width="95px" style="vertical-align:top">character 3 ||<width="105px" style="vertical-align:top">CHA || ||<width="79px" style="vertical-align:top">28 ||<width="229px" style="vertical-align:top">Country of first registration of sire of animal^3^ ||<width="95px" style="vertical-align:top">character 3 ||<width="105px" style="vertical-align:top">DNK || ||<width="79px" style="vertical-align:top">31 ||<width="229px" style="vertical-align:top">Sex ||<width="95px" style="vertical-align:top">character 1 ||<width="105px" style="vertical-align:top">M || ||<width="79px" style="vertical-align:top">32 ||<width="229px" style="vertical-align:top">ID number of sire of animal^4^ ||<width="95px" style="vertical-align:top">character 12 ||<width="105px" style="vertical-align:top">654789321852 || |
Line 313: | Line 326: |
||<width="79px" style="vertical-align:top"> ||<width="229px" style="vertical-align:top">'''International ID of Dam of ANIMAL''' ||<width="95px" style="vertical-align:top"> ||<width="105px" style="vertical-align:top"> || ||<width="79px" style="vertical-align:top">45 ||<width="229px" style="vertical-align:top">Breedof dam of animal ^2^ ||<width="95px" style="vertical-align:top">character 3 ||<width="105px" style="vertical-align:top">CHA|| ||<width="79px" style="vertical-align:top">48 ||<width="229px" style="vertical-align:top">Country of first registration of dam of animal^3^ ||<width="95px" style="vertical-align:top">character 3 ||<width="105px" style="vertical-align:top">DNK|| ||<width="79px" style="vertical-align:top">51 ||<width="229px" style="vertical-align:top">Sex ||<width="95px" style="vertical-align:top">character 1 ||<width="105px" style="vertical-align:top">F|| ||<width="79px" style="vertical-align:top">52 ||<width="229px" style="vertical-align:top">ID number of dam of animal^4^ ||<width="95px" style="vertical-align:top">character 12 ||<width="105px" style="vertical-align:top">852147963753|| ||<width="79px" style="vertical-align:top">65 ||<width="229px" style="vertical-align:top">Birth date of animal (YYYYMMDD) ||<width="95px" style="vertical-align:top">integer 8 ||<width="105px" style="vertical-align:top">19861223|| ||<width="79px" style="vertical-align:top">74 ||<width="229px" style="vertical-align:top">Name of animal^6^ ||<width="95px" style="vertical-align:top">character 30 ||<width="105px" style="vertical-align:top">CHANTAL|| ||<width="79px" style="vertical-align:top">105 ||<width="229px" style="vertical-align:top">Country sending information ||<width="95px" style="vertical-align:top">character 3 ||<width="105px" style="vertical-align:top">DNK|| |
||<width="79px" style="vertical-align:top"> ||<width="229px" style="vertical-align:top">International ID of Dam of ANIMAL''' ''' ||<width="95px" style="vertical-align:top"> ||<width="105px" style="vertical-align:top"> || ||<width="79px" style="vertical-align:top">45 ||<width="229px" style="vertical-align:top">Breedof dam of animal ^2^ ||<width="95px" style="vertical-align:top">character 3 ||<width="105px" style="vertical-align:top">CHA || ||<width="79px" style="vertical-align:top">48 ||<width="229px" style="vertical-align:top">Country of first registration of dam of animal^3^ ||<width="95px" style="vertical-align:top">character 3 ||<width="105px" style="vertical-align:top">DNK || ||<width="79px" style="vertical-align:top">51 ||<width="229px" style="vertical-align:top">Sex ||<width="95px" style="vertical-align:top">character 1 ||<width="105px" style="vertical-align:top">F || ||<width="79px" style="vertical-align:top">52 ||<width="229px" style="vertical-align:top">ID number of dam of animal^4^ ||<width="95px" style="vertical-align:top">character 12 ||<width="105px" style="vertical-align:top">852147963753 || ||<width="79px" style="vertical-align:top">65 ||<width="229px" style="vertical-align:top">Birth date of animal (YYYYMMDD) ||<width="95px" style="vertical-align:top">integer 8 ||<width="105px" style="vertical-align:top">19861223 || ||<width="79px" style="vertical-align:top">74 ||<width="229px" style="vertical-align:top">Name of animal^6^ ||<width="95px" style="vertical-align:top">character 30 ||<width="105px" style="vertical-align:top">CHANTAL || ||<width="79px" style="vertical-align:top; ">105 ||<width="229px" style="vertical-align:top; ">Country sending information ||<width="95px" style="vertical-align:top; ">character 3 ||<width="105px" style="vertical-align:top; ">DNK || ||||||||<width="79px" style="vertical-align:top;text-align:center">Character encoding: UTF-8 || |
Line 324: | Line 338: |
(Creates Cross-reference links, valid for dairy and beef users) ||<tablestyle="text-align:left"style="vertical-align:top">'''Field description''' ||<style="vertical-align:top">'''Label''' ||<style="vertical-align:top">'''Format''' ||<style="vertical-align:top">'''Start''' ||<style="vertical-align:top">'''length''' ||<style="vertical-align:top">'''Comments''' || |
'''(Creates Cross-reference links, valid for dairy and beef users) ||<tablestyle="text-align:left"style="vertical-align:top">Field description ''' ''' ||<style="vertical-align:top">Label ''' ''' ||<style="vertical-align:top">Format ''' ''' ||<style="vertical-align:top">Start ''' ''' ||<style="vertical-align:top">length ''' ''' ||<style="vertical-align:top">Comments ''' ''' || |
Line 328: | Line 342: |
||<style="vertical-align:top">Correct IID ||<style="vertical-align:top">R_AIID ||<style="vertical-align:top">ASCII ||<style="vertical-align:top">25 ||<style="vertical-align:top">19 ||<style="vertical-align:top">usual structure of IID || | ||<style="vertical-align:top;">Correct IID ||<style="vertical-align:top;">R_AIID ||<style="vertical-align:top;">ASCII ||<style="vertical-align:top;">25 ||<style="vertical-align:top;">19 ||<style="vertical-align:top;">usual structure of IID || ||||||||||||<style="vertical-align:top;text-align:center">Character encoding: UTF-8 || ''' |
Line 334: | Line 351: |
||<tablewidth="621px" tablestyle="text-align:left"style="vertical-align:top">'''Field description''' ||<style="vertical-align:top">'''Label''' ||<style="vertical-align:top">'''Format''' ||<style="vertical-align:top">'''Start''' ||<style="vertical-align:top">'''length''' ||<width="165px" style="vertical-align:top">'''Comments''' || | ||<tablewidth="621px" tablestyle="text-align:left"style="vertical-align:top">Field description''' ''' ||<style="vertical-align:top">Label''' ''' ||<style="vertical-align:top">Format''' ''' ||<style="vertical-align:top">Start''' ''' ||<style="vertical-align:top">length''' ''' ||<width="165px" style="vertical-align:top">Comments''' ''' || |
Line 336: | Line 353: |
||<style="vertical-align:top">'''Animal IID''' ||<style="vertical-align:top">A_IID ||<style="vertical-align:top">'''ASCII''' ||<style="vertical-align:top">'''5''' ||<style="vertical-align:top">'''19''' ||<width="165px" style="vertical-align:top">'''usual structure of IID''' || ||<style="vertical-align:top">'''Sire IID''' ||<style="vertical-align:top">'''S_IID''' ||<style="vertical-align:top">'''ASCII''' ||<style="vertical-align:top">'''25''' ||<style="vertical-align:top">'''19''' ||<width="165px" style="vertical-align:top">'''usual structure of IID''' || ||<style="vertical-align:top">'''Dam IID''' ||<style="vertical-align:top">'''D_IID''' ||<style="vertical-align:top">'''ASCII''' ||<style="vertical-align:top">'''45''' ||<style="vertical-align:top">'''19''' ||<width="165px" style="vertical-align:top">'''usual structure of IID''' || |
||<style="vertical-align:top">Animal IID''' ''' ||<style="vertical-align:top">A_IID ||<style="vertical-align:top">ASCII''' ''' ||<style="vertical-align:top">5''' ''' ||<style="vertical-align:top">19''' ''' ||<width="165px" style="vertical-align:top">usual structure of IID''' ''' || ||<style="vertical-align:top">Sire IID''' ''' ||<style="vertical-align:top">S_IID''' ''' ||<style="vertical-align:top">ASCII''' ''' ||<style="vertical-align:top">25''' ''' ||<style="vertical-align:top">19''' ''' ||<width="165px" style="vertical-align:top">usual structure of IID''' ''' || ||<style="vertical-align:top">Dam IID''' ''' ||<style="vertical-align:top">D_IID''' ''' ||<style="vertical-align:top">ASCII''' ''' ||<style="vertical-align:top">45''' ''' ||<style="vertical-align:top">19''' ''' ||<width="165px" style="vertical-align:top">usual structure of IID''' ''' || |
Line 342: | Line 359: |
||<style="vertical-align:top">Breed composition ||<style="vertical-align:top">A_breedcomp ||<style="vertical-align:top">ASCII ||<style="vertical-align:top">120 ||<style="vertical-align:top">8 ||<width="165px" style="vertical-align:top">To be left blank for the time being. || | ||<style="vertical-align:top;">Breed composition ||<style="vertical-align:top;">A_breedcomp ||<style="vertical-align:top;">ASCII ||<style="vertical-align:top;">120 ||<style="vertical-align:top;">8 ||<width="165px" style="vertical-align:top; ">To be left blank for the time being. || ||||||||||||<style="vertical-align:top;text-align:center">Character encoding: UTF-8 || |
Line 348: | Line 366: |
Each record line is separated from the next by a ‘\n’ ||<tablewidth="621px" tablestyle="text-align:left"style="vertical-align:top">'''Field description''' ||<style="vertical-align:top">'''Label''' ||<style="vertical-align:top">'''Format''' ||<style="vertical-align:top">'''Start''' ||<style="vertical-align:top">'''length''' ||<width="165px" style="vertical-align:top">'''Comments''' || |
Each record line is separated from the next by a ‘\n’ ''' ||<tablewidth="621px" tablestyle="text-align:left"style="vertical-align:top">Field description ''' ''' ||<style="vertical-align:top">Label ''' ''' ||<style="vertical-align:top">Format ''' ''' ||<style="vertical-align:top">Start ''' ''' ||<style="vertical-align:top">length ''' ''' ||<width="165px" style="vertical-align:top">Comments ''' ''' || |
Line 355: | Line 373: |
||<style="vertical-align:top">Animal Name ||<style="vertical-align:top">A_NAME ||<style="vertical-align:top">ASCII ||<style="vertical-align:top">85 ||<style="vertical-align:top">30 ||<width="165px" style="vertical-align:top"> || | ||<style="vertical-align:top;">Animal Name ||<style="vertical-align:top;">A_NAME ||<style="vertical-align:top;">ASCII ||<style="vertical-align:top;">85 ||<style="vertical-align:top;">30 ||<width="165px" style="vertical-align:top; "> || ||||||||||||<style="vertical-align:top;text-align:center">Character encoding: UTF-8 || ''' |
Line 361: | Line 382: |
'''Q.''' How do I know that the pedigree file I have submitted has been successfully uploaded into the database? '''A.''' You will receive a confirmation email with some information on the data you have uploaded, i.e. total number of records and number of records validated by default, i.e. number of new domestic animals you have uploaded.The time of receiving the email depends on the size of the pedigree you have uploaded. If the size of the file is ≤100 kb it gets uploaded in real time and you will shortly after receive the confirmation email. If the size of the file is ≥100 kb it gets uploaded during Swedish night hours as the process requires more time. In that case you will receive a confirmation email the next morning, containing the above mentioned information.You are kindly asked to notify the Interbull staff if you have not received any emails 24 hours after uploading of the file. '''Q.''' What is the difference between “'''''Overview of verified/unverified animals.." '''and "'''''Summary of animals waiting for verification..."'''''? '' '''A.''' In the first statistic you can see how the verification process is proceeding on your foreign animals. In the second statistic you get an overview of how many animals reported by other organizations are still waiting for your verification. '''Q.''' How do I know if I have any animal to verify? '''A.''' By clicking on “Statistic/'''''Overview of verified/unverified animals'''''” the table will show you the number of animals you need to verify and their reporting country. '''Q.''' What do I do if I have animals pending verification? '''A.''' Download from the main menu the request of pedigree file. For each of the animal listed in the file you need to provide pedigree information as they appear in your own database and upload them using a file200 format previously checked by CheckPedigree.pl. If you notice that the IID of the animals is wrong or is an alias ID then you also have to submit a file202. '''Q.''' What I have to do if some IIDs listed in the request of pedigree cannot be found in my own database? '''A.''' In this case you only have to submit a file202 with 19 “U”s (i.e. UUUUUUUUUUUUUUUUUUU) in the correct IID field. '''Q.''' What do I do if I notice that an animal has been reported using a cross-reference ID instead than the official IID? '''A.''' Provide the pedigree information for that animal as it appears in your own database using a file200 previously checked by CheckPedigree.pl and also provide a file202 putting the correct official IID in the correct IID field. '''Q.''' Can the actual system distinguish between ID formally correct but written in a different format and the real wrong ID? '''A.''' Anytime the authoritative organization provides a file202 the “wrong/alias ID” gets stored in a particular table called “alternative scheme table”. The system does not distinguish between “formally correct” or “real wrong” IDs. The system is built on the principle that every ID is considered as potentially wrong until it gets validated by the authoritative organization. If an authoritative organization provides a “correct ID” (cross-reference link, file202) it means that the ID provided by the reporting organization was not entirely correct so it gets replaced with the one provided by the authoritative organization. The information provided by the reporting country is not lost but stored in the alternative scheme table. In case the ID reported in the correct field is represented by the unknown ID (i.e. 19 “U”s) then that ID is treated as “real wrong” and placed in the limbo space. '''Q.''' Can I download pedigree information from the interface? '''A.''' After every evaluation you will be able to download the international pedigree for the breeds evaluated at the Centre and for which you participate to the Interbull evaluation. |
Q.''' How do I know that the pedigree file I have submitted has been successfully uploaded into the database? ''' A.''' You will receive a confirmation email with some information on the data you have uploaded, i.e. total number of records and number of records validated by default, i.e. number of new domestic animals you have uploaded.The time of receiving the email depends on the size of the pedigree you have uploaded. If the size of the file is ≤100 kb it gets uploaded in real time and you will shortly after receive the confirmation email. If the size of the file is ≥100 kb it gets uploaded during Swedish night hours as the process requires more time. In that case you will receive a confirmation email the next morning, containing the above mentioned information.You are kindly asked to notify the Interbull staff if you have not received any emails 24 hours after uploading of the file. ''' Q.''' What is the difference between “'''''Overview of verified/unverified animals.." '''and "'''''Summary of animals waiting for verification..."'''''? '' ''' A.''' In the first statistic you can see how the verification process is proceeding on your foreign animals. In the second statistic you get an overview of how many animals reported by other organizations are still waiting for your verification. ''' Q.''' How do I know if I have any animal to verify? ''' A.''' By clicking on “Statistic/'''''Overview of verified/unverified animals'''''” the table will show you the number of animals you need to verify and their reporting country. ''' Q.''' What do I do if I have animals pending verification? ''' A.''' Download from the main menu the request of pedigree file. For each of the animal listed in the file you need to provide pedigree information as they appear in your own database and upload them using a file200 format previously checked by CheckPedigree.pl. If you notice that the IID of the animals is wrong or is an alias ID then you also have to submit a file202. ''' Q.''' What I have to do if some IIDs listed in the request of pedigree cannot be found in my own database? ''' A.''' In this case you only have to submit a file202 with 19 “U”s (i.e. UUUUUUUUUUUUUUUUUUU) in the correct IID field. ''' Q.''' What do I do if I notice that an animal has been reported using a cross-reference ID instead than the official IID? ''' A.''' Provide the pedigree information for that animal as it appears in your own database using a file200 previously checked by CheckPedigree.pl and also provide a file202 putting the correct official IID in the correct IID field. ''' Q.''' Can the actual system distinguish between ID formally correct but written in a different format and the real wrong ID? ''' A.''' Anytime the authoritative organization provides a file202 the “wrong/alias ID” gets stored in a particular table called “alternative scheme table”. The system does not distinguish between “formally correct” or “real wrong” IDs. The system is built on the principle that every ID is considered as potentially wrong until it gets validated by the authoritative organization. If an authoritative organization provides a “correct ID” (cross-reference link, file202) it means that the ID provided by the reporting organization was not entirely correct so it gets replaced with the one provided by the authoritative organization. The information provided by the reporting country is not lost but stored in the alternative scheme table. In case the ID reported in the correct field is represented by the unknown ID (i.e. 19 “U”s) then that ID is treated as “real wrong” and placed in the limbo space. ''' Q.''' Can I download pedigree information from the interface? ''' A.''' After every evaluation you will be able to download the international pedigree for the breeds evaluated at the Centre and for which you participate to the Interbull evaluation. ''' |
USER MANUAL FOR THE IDEA INTERFACE
Preface
The following is a manual to guide the user through the features of the new IDEA. IDEA stands for Interbull Data Exchange Area. IDEA is a restricted area accessible only to member countries through the Interbull website.
- Last updated May 16 , 2012
Contents
- USER MANUAL FOR THE IDEA INTERFACE
-
Organization codes
- APPENDIX II: File Format 200 for Dairy Pedigree
- APPENDIX IIa:File Format for Beef Pedigree
- APPENDIX III: Format File202 Correcting Internationa ID by the Authoritative Organization
- APPENDIX IV: Request of Pedigree for Authoritative Organization
- APPENDIX V: Corrected Foreign Animals
- APPENDIX VI: FREQUENTLY ASKED QUESTIONS
LOG IN
To enter the main page of IDEA go to https://idea.interbull.org You will be required to provide a username and password to log in.
Your username is equal to the intial of your name followed by your surname. For example, the user name for Thomas White will be twhite. If your surname contains special character, such as ö, ä, å etch, write it with the corresponding ASCII letters, i.e. o,a, etc.
Your username is associated to the organization you belong to. IDEA has a table linking together usernames and organizations for the persons that have had so far regular contacts with the Centre. If you wish for one of your co-worker to have access to IDEA, simply notify the Centre with his/her name and email address.
Access to IDEA is, therefore, set to an individual access. If you used to share your password in the past, it is your responsability to change it to a new password.
First time log in
You will receive a temporary password from Interbull Centre. Use your username, as described above, and your temporary password to log in.
AFTER YOU LOG IN
Welcome to IDEA start!!!
The first thing you need to do is to change the temporary password to one of your choice.You can do it right on "IDEA start" by clicking on "Change your password". You can also update your email address by clicking on "Change email"
The Menu List appears in the top navigation pane with several menu items that will allow you to interact with the database. In this section we give you an explanation of their functions.
IDEA Start
The IDEA Start menu gives you access to the main functions available in the database. Currently these functions are solely related to the pedigree handling, but new functions for handling of conventional MACE, genotypes etc, will also be accessible from here whenever their modules will be implemented.
The available pedigree functions are: Query, Uploads, Conflicts, Statistics.
Software
The Software menu gives you access to the Interbull checking programs. By clicking on Software a drop down menu will open and you will be able to choose the type of checking program you are interested in, i.e. Pedigree, Proofs or GenoList.
Pedigree's Checking Programs
Two Pythons programs are available for checking pedigree, they are CheckPedigree.py and CheckLinks.py. Under Software|Pedigree you will find information on each of the programs together with the latest version of the program to download. Please note that the programs check their internal version with the value stored on the Interbull server. You will have to download the most recent version if there is a mismatch. This implies that you have to have access to an internet connection to be able to run the programs.
Pedigree
The Pedigree menu gives you access to the main pedigree functions which are: Animal Query, Uploads, Conflicts and Statistics. These functions are also accessible from the IDEA Start menu.
Animal Query
If you want to get pedigree information on a particular animal, click on Animal Query menu link.The page that will open contains an Animal lookup,by inserting an International ID in the Animal lookup and then clicking on Lookup! will show the information related to your query.
The central part of the page will show the international ID of the animal you were interested, followed by its name, birth date and birth date status, animal status, date of last update and who performed the last update. A description of all possible birthdate and animal status are presented in Table 1.
Table 1: Birthdate and Animal status
|
Status |
Meaning |
Birthdate |
ACTUAL |
The organization has provided a real entry of the type YYYYMMDD |
|
Org_estimated |
The record has been loaded as YYYYMM00 or YYYY0000. |
|
IBC_estimated |
the record has been loaded as missing (000000) or has been re-estimated due to birthdate conflicts in the database. |
Animal |
AUTH_VERIFIED |
The animal has been uploaded by the authoritative organization |
|
NOT_VERIFIED |
The animal has been uploaded by a reporting organization |
|
AUTO_CREATED |
Special status assigned to IDs which do not have an entry as animal, i.e. they appear only as sire or dam. |
Above the animal information, you will see the animal's parents and grand-parents. The animal's parents are displayed together with their name, birth date and birth date status and animal status. Grandparents are displayed as active links, clicking on their ID will update the Animal Query withe their pedigree information, if available in the system.
Below the animal information, you will find a table listing all animal's offspring together with their name and birth date. The table, by default, shows the first 200 offsprings associated to that particular animal ID. You can however modify the number of entries by clicking on the harrow beside "entries". Likewise, if you are only interested on a specific offspring, you can search for it by inserting its IID in the "search" space. Each header in the table is an active buttom, this means that by clicking on them you have the possibility to sort the content of the table in the way that suits you better.
Each ID reported in the parents and offspring section is an active link, therefore clicking on any displayed ID will update the page with that animal’s pedigree information.
If you enter an alias ID in the Animal lookup space you will see the official IID associated to that alias id.
ADD PICTURE OF ANIMAL QUERY
Table 2: Different types of organization and their authority level
Organization |
Definition |
Authority |
Authority Organization |
The country-breed combination in the animal ID belongs to this organization |
Full authority every time. |
First Reporting Organization |
The country-breed combination does not belong to this organization but it has been the first one uploading this record. |
Temporary authority, can modify pedigree information of a reported animal as long as it is still unverified by its authoritative organization. |
Reporting Organization |
The country-breed combination does not belong to this organization AND it has NOT been the first one uploading this record. |
None, can never modify pedigree information |
Pedigree Upload
The Uploads menu link is set up for uploading of pedigree and link (cross-reference) files. These files have to be created according to the format reported in APPENDIX I, file format 200 for dairy pedigree, file format 601 for beef pedigree and file format 202 for link files, valid for both dairy and beef. The content of your files needs to be checked by running two pythons programs: CheckPedigree.py and CheckLinks.py. If the programs find no errors in the format or in the content of your files than they will produce two zip files, IB-org_code-yyyymmddThhmmss.zip (containing the file200 or file601) and IB202-org_code-yyyymmddThhmmss.zip (containing the file202). These files are the only files that can be uploaded into IDEA, any other file will be rejected.
After uploading, the same checks performed by the checking programs will be performed once again inside IDEA therefore any manipulation of the zip files would be useless as the files will get rejected.
Access to the programs and their instruction is via the Software menu link.
To upload your files, browse them using the Browse buttom and upload it by clicking on Upload.
Whithin few minutes you will receive an email with the outcome of your uploading: if it was successful or if it failed for some reasons.
Attached to the confirmation email you will find two files called "processed.txt" and "not_processed.txt". The "processed.txt" contains all animals that have been inserted in the database and, eventually, other information such as:
- Automatically created due to parent link (see Table 1).
- The birth date is in conflict with birth date(s) of related animal(s)
- Country estimated birth date has been re-estimated by IBC due to conflicting birth dates
The "not_processed.txt" contains all animals that have been skipped and therefore not included in the database. Reasons for exclusion can be:
- Identical data already exists on the server
- No authority over existing animal
Creation of cross reference in the database
The creation of cross references in the database is made by uploading of a IB202-org_code-yyyymmddThhmmss.zip (file202 previously checked by CheckLinks.py). Two IDs will be always considered as two different animals until a proper file202 is uploaded.
In IDEA you can create cross-reference for the following situations:
- linking your domestic animals, i.e. animals for which you are the authoritative organization;
- correcting the ID of your foreign animals (if you are the first reporting organization, see Table 2);
- adding national IDs to a given international ID.
Please be advised that IDEA does not discern between international and national aliases as it solely relies on the international ID.
In IDEA you can now submit cross-references for animals outside your authority. In this case the pair you are trying to link together will be treated as potential duplicates and listed in the corresponding authoritative organization's potential duplicates page, with your choice highlighted.The linking will be performed only if the authoritative organization agrees with your choice.
The table below summarizes all possible linking scenarioes together with an explanation of what will happen inside IDEA.
Table 3: Possible linking actions
AID1 and AID2 are according to the format of file202, therefore AID1=wrong/alias AID and AID2=international AID.
In case of records that fit in the conditions for more than one case, the first case in the table takes precedence. Case DB info1 Authority2 Other conditions Actions during loading AID1 AID2 AID1 AID2 1a Not in DB Not in DB - - Skip+warn: Neither AID is present in the DB 1b Not in DB Animal Full - - Add AID1 as an alias to AID2 in the DB. 1c Not in DB Animal None - - Skip and warn. 2 - Alias - - - Skip+warn: AID2 is an alias in the DB - please use primary identifier 3 - Animal - - AID2 invalid in DB Skip+warn: AID2 is marked as invalid in the DB - no new links are allowed 4a Alias - Full - AID2 is UUUUUUUUUUUUUUUUUUU Flag alias AID1 as invalid in DB 4b Alias - None - AID2 is UUUUUUUUUUUUUUUUUUU Skip+warn: No authority to invalidate alias AID1 4c Animal - Full - AID2 is UUUUUUUUUUUUUUUUUUU Flag animal for invalid AID in DB 4d Animal - None - AID2 is UUUUUUUUUUUUUUUUUUU Skip+warn: No authority to invalidate animal AID1 5a Animal Absent Any - AID1 is invalid in DB Make AID2 the primary ID with status NOT_VERIFIED; Make AID1 alias with invalid status 5b Animal Absent None - AID1 is invalid in DB Skip+warn: No authority to correct AID1 6a Alias Animal - - AID1 already aliased to AID2 Skip silently 6b Alias Animal - - AID1 alias to another IID Skip+warn: AID1 already linked to another animal - contact IBC staff 7a Animal Animal Any Any - Merge animals making all references to animal AID1 point to AID2; make AID1 alias for AID2; 7b Animal Animal Any None - Create potential duplicate pair; warn:This link must be confirmed on-line by the organisation with authority for AID2 7c Animal Animal None Any - Create potential duplicate pair; warn:This link must be confirmed on-line by the organisation with authority for AID1 7c Animal Animal None None - Create potential duplicate pair 1 'Absent' AID is not present in the DB either as a primary ID or as an alias; 'Animal': AID is present as the international id; 'Alias': AID is present as an alias; '-' Regardless if it is present, absent, animal or alias. 2 'Full': authoritative organization; 'None': Not authoritative organization; 'Any': either authoritative organization or first reporting organization;'-' Regardless
Name of the animal
The official name of an animal is equal to the name provided by each official organization. To avoid sudden changes in names or name missing it is extremely important that each authoritative organization always provide a name record, whenever available, for every uploading and be consistent with the name, i.e. do not provide the full name for the first uploading and a short version of it for the next, otherwise the name of the animal will get overwritten.
Please note that IDEA is based on a UTF-8 character encoding. It is recommended that all files entering IDEA would use a UTF-8 character encoding as well.
How do I change/add a name for a given animal?
Only authoritative organization or first reporting organization, while the record is till unverified, can modify the name of an animal. To do so simply upload a pedigree file with the new name information and the changes will be recorded in the database.
Statistics menu link
Clicking on the Download button you will be able to get information about pedigree, proofs, parameters, forms, retrieve a list of animals waiting for your validation (as you appear to be their authoritative organization) or check the list of invalid international ID. Many of the features contained in this tab are still under development but you can already get access to the list of animals waiting for your validation as well as check the invalid international id.
Retrieve your "Request of Pedigree"
By clicking on here you will be directed into an ascii file following the format shown in Appendix IV. You can save the file by clicking on “File/Save As” in the tool bar.The ascii file contains a list of all animals as loaded by reporting countries and for which you appear as the authoritative organization. This means that only you have the right to say if the pedigree record is correct or not.
Verification Process: How does it work?
For each animal listed in your “Request of Pedigree” file yhave to upload its pedigree information as it appears in your own database, using file format 200 and checkpedigree.pl.By doing so you are verifying the reported information as the system considers verified only the information provided by the authority organization. When you are verifying an animal record you might find yourself in front of four possible scenarios, below you find instructions on what to do for each of them.
Scenario 1
If you find that the animal ID reported is correct then you will have to:
Upload a pedigree file (file200 previously inspected by CheckPedigree.pl) as it appears in your own database, weather the reported pedigree information is correct or not.
Scenario 2
If you notice that an animal has been reported with an incorrect international id then you will have to:
- Upload a pedigree record for that animal using its correct id
- AND upload a file202. The file202 will provide the cross-reference link between the reported animal id and the animal id you verified.
Example:
A country submitted a pedigree for the animal BSWUSAF000000569466 using the ID BSWUSAF000000659466.
As it is an USA animal, the animal will appear in the USA list of Request of Pedigree. When looking at the record USA notices that two numbers have been misplaced. So USA will upload a pedigree file using the correct id for the animal (BSWUSAF000000569466) together with a file202 which will look like:
202 BSWUSAF000000659466 BSWUSAF000000569466
Scenario 3
If you realize that a given animal has been erroneously associated to your organization then:
- If you know the right authoritative organization, upload a pedigree file containing the new international ID of that animal. Doing so the animal will be sent for validation to the organization associated to the country you specified in its international ID.
Example:
Animal BSWUSAM000803611398 is sent to USA for validation but USA realizes the animal belong to DEU instead.
USA uploads a file200 (checked by CheckPedigree.pl) for the animal BSWDEUM000803611398
Scenario 4
If you do not know anything about that animal and it does not appear in your database then you have to:
- Upload a file202 containing “UUUUUUUUUUUUUUUUUUU” in the “correct IID” field.
Doing so the animal’s international ID will be considered as invalid and listed in the limbo (for the limbo see below)
Example:
Animal BSWUSAM000000000008 cannot be found in the USA database.The file 202 will be:
202 BSWUSAM000000000008 UUUUUUUUUUUUUUUUUUU
You will have to upload your files using the uploading pedigree tool you find in the upload tab.
Corrected Foreign Animals
In this file you find information on the validation activity over an IID, and its pedigree, done by each authoritative organization on your foreign animals. Therefore by checking it you can get the corrected IDs, or pedigrees, of some of the animals you have been reported that have been corrected by their authoritative organizations.You can open the file by clicking on the link or save it directly on your computer. The file format is specified in Appendix V.
The content of the file will be completely updated after extraction of the pedigree for each Interbull evaluation. You therefore have the time between extractions to check the file and eventually do the necessary correction in your own database.
Invalid IDs
By clicking on the limbo tab you will get access to the list of international IDs that were not recognized by their authoritative organizations and therefore set to unknown. The list is available for you to double check your database and eventually update it accordingly.
Download Pedigree
After every Interbull evaluations the international pedigree for the six breeds evaluated at the Centre will be available for download. By clicking on Download Pedigree you will have access to the international pedigree used in the latest Interbull evaluation. You will be entitled to have access only to the international pedigree of the official breed(s) with which you participate to the Interbull evaluation.You will be able to either look at the pedigree or saved it on your own computer.
Conflicts Menu Link
The Statistics menu link contains general information about your pedigree.
Overview of verified/unverified animals submitted by your organization
The table shows the general situation of your pedigree data as it is in the database at the time of your log in. The table contains the country of the authoritative organization, the number of animals that have already been validated by it and the number of animals that are still waiting for validation, for all the breeds you have submitted. By clicking on the drop down menu you can select a particular breed among your own and have the same statistics recalculated just for that breed.
N.B. among all the animals in the “animal” field that you have uploaded, the ones having your country code in their international ID are considered validated by default because you are their authoritative organization, therefore there should not be any animals still pending validation by your country in this table. If this is not the case it means that there are some parents without an entry in the animal field and could not be validated because the validation procedure takes place in the animal field. To prevent this to happen, you will have to upload pedigree records for the animals and their parents as well.
Summary of animals waiting for verification by your organization
This table contains the list of all animals submitted to the Interbull database by other organizations for which you appear to be the authoritative organization and therefore you need to provide the correct information (see verification procedure above) . The table contains the total number of records, the reporting organization’s name and its country code. This table is useful for you to monitor your verifying ID tasks.
Pedigree Conflicts
Although your national pedigree file has been already checked by the CheckPedigree.pl for pedigree conflicts, there is the possibility that the international pedigree still shows some birthdays conflicts.To check for that click on Pedigree Conflicts bottom, you will be directed into a new page showing all conflicts where your organization is involved. Below is an explenation of the Pedigree Conflicts page content:
The IID listed is the one of an animal in which pedigree there is one of more conflicts. The type of conflicts are shown in the Conflict path column, where S, D, SD means that the sire, the dam or the sire of the dam birthdate is conflicting with the animal’s birthdate.
The cross (x) in the “Strange” column indicates that all animals involved in the conflict have already been verified by their own authoritative organization.
Clicking on “Details” will open a new page showing more details on the animals in conflict.
How to handle animal's conflicts?
Sometimes a conflict could be due to unverified animals, if this is the case please proceed on verifying the animals double checking that the new birthdate you are going to provide will no more be in conflict.
If you do not know how to fix the conflict you should contact Interbull Centre deciding what action you, as the authoritative organization for that animal, want to take.
So, in general, to fix a conflict you should:
- Upload new pedigree file of the conflicting animal with a new no-conflicting birthdate
In case you do not know how to fix it you should contact Interbull Centre
Pedigree Duplicates
By clicking on “Pedigree Duplicates” you will see a list of potential duplicates associated to your organization. The list shows five pairs at the time.
For each animal listed you will see its international IID and birthday, by clicking on its IID you will access to its pedigree information. Beside each IID you have an empty box to mark.
How to handle pedigree duplicates?
In case you realize that the animals shown in the list are indeed duplicates, mark the box associated to the official IID. If the animals are NOT duplicates mark both boxes. Then press “Submit Changes” and the changes will be saved and stored in the database.
The pairs you have processed will be dropped from your list only if you are authority for both animals in the pair. Otherwise the conflict will remain in your list until the other authoritative organization provides your same answer.
What is the meaning of the star?
Whenever you are authoritative only for one animal IID showed in the pair, your submission will be kept on a hold and showed with a star (*) until the other authoritative organation has also the opportunity to look into the matter and expressed its own opinion. There can be two different scenarios:
- You and the other authoritative organization have submitted the same information: The change will then become official in the database and the pair will drop from your list.
- You and the other authoritative information have provided different information:The “disagreement” will be mark by stars (*) in both IID. No changes will happen in the database. You should contact the other authoritative organization via Interbull Centre. The conflict remains in your list.
APPENDIX I: Organization Codes as provided by Interbull Centre
Organization codes refer to the codes assigned by Interbull Centre to the organizations that have access to the restricted area of Interbull's web page and that are responsible for uploading and dowloading data to and from Interbull data base. Such codes are not meant to be used in any other context. Organization Code Organization Name Country Note DATAGENE Solutions for Herd Development Australia GEMBLOUX Gembloux Agricultural University, Animal Breeding and Genetics group Belgium LACTANET Canadian Network for Dairy Excellence Canada HAPIH Croatian Agency for Agriculture and Food Croatia PLEMDAT Czech Moravian Breeders' Corporation Czech Rep. NAV Nordic Cattle Genetic Evaluation Denmark ARC Estonian Animal Recording Centre Estonia GENEVAL French Genetic Evaluation Centre France LFL Bavarian State Research Center for Agriculture, Institute of Animal Breeding Germany VIT United Data Systems Germany MGSZH National Institute for Agricultural Quality Control Hungary ICBA Israeli Cattle Breeders' Association Israel ICBF Irish Cattle Breeding Federation Ireland ANARB Italian Brown Cattle Breeder's Association Italy ANAFI National Association of Holstein Breeders Italy ANAPRI Italian Simmental Fleckvieh Breeder's Association Italy NLBC National Livestock Breeding Centre Japan LIETUVA Ministry of Agricolture Lithuania LDC Agricultural Data Centre Latvia GENO GENO Norway DNZ Dairy New Zealand New Zealand NIAP National Research Institute of Animal Production Poland ANABLE Portuguese Research centre Portugal PSSR The Breeding Services of the Slovak Republic Slovak Rep BFRO University of Ljubljana, Zootechnical department Slovenia NIAS Korean National Institute of Animal Science South Korea CONAFE Confederation of Spanish Holstein Associations Spain QUALITAS Qualitas AG Switzerland CRV CRV-VRV+belgium flemish The Netherlands SRUC Scottish Agricultural College Great Britain INIA Instituto Nacional de Investigacion Agropecuaria Uruguay CDCB Council on dairy Cattle Breeding USA HAUSA Holstein Association, USA USA ZUCHTDATA ZuchtData EDV Germany SASB SA Studbook South Africa SASBB SA studbook_INTERBEEF South Africa CMBCB Czech Moravian Breeders Corporation_INTERBEEF Czech Republic FABAB Faba Coop_INTERBEEF Finland ICBFB Irish Cattle Breeding Federation_INTERBEEF Ireland GENEVALB French Genetic Evaluation Centre_INTERBEEF France NAVB Nordic Cattle Genetic Evaluation_INTERBEEF Denmark VITB United Data Systems_INTERBEEF Germany SRUCB Scottish Agricultural College_INTERBEEF Great Britain SDAB Swedish Dairy Association_INTERBEEF Sweden MUTTERKUHB Swish Beef Cattle Association Switzerland ABRIB Agricultural Business Research Institute for Beef Australia LDCB Agricultural Data Centre for Beef Latvia BFROB University of Ljubljana, Zootechnical department for Beef Slovenia Organization codes
APPENDIX II: File Format 200 for Dairy Pedigree
|
|||
Starting position |
Field |
Format |
Example |
1 |
Record type1 |
Character 3 |
200 |
|
International ID of ANIMAL |
|
|
5 |
Breed of animal 2 |
character 3 |
HOL |
8 |
Country of first registration of animal3 |
character 3 |
CAN |
11 |
Sex |
character 1 |
M |
12 |
ID number of animal4 |
character 12 |
000000A12345 |
|
|
|
|
|
International ID of Sire of ANIMAL |
|
|
25 |
Breed of sire of animal |
character 3 |
HOL |
28 |
Country of first registration of sire of animal3 |
character 3 |
CAN |
31 |
Sex |
character 1 |
M |
32 |
ID number of sire of animal4 |
character 12 |
556912367589 |
|
|
|
|
|
International ID of Dam of ANIMAL |
|
|
45 |
Breed of dam of animal 2 |
character 3 |
HOL |
48 |
Country of first registration of dam of animal3 |
character 3 |
CAN |
51 |
Sex |
character 1 |
F |
52 |
ID number of dam of animal4 |
character 12 |
123569874521 |
|
|
|
|
65 |
Birth date of animal (YYYYMMDD) |
integer 8 |
19870215 |
74 |
Status of animal5 |
Integer 2 |
10 |
77 |
Birth date of first AI daughters (YYYYMMDD) |
Integer 8 |
19890314 |
86 |
Name of animal6 |
character 30 |
Cantarello |
|
|
|
|
|
National ID of ANIMAL |
|
|
117 |
Breed of animal2 |
character 3 |
HOL |
120 |
Country |
character 3 |
CAN |
123 |
Sex |
character 1 |
M |
124 |
ID number of animal4 |
character 12 |
000000A12345 |
|
|
|
|
137 |
Country sending information |
character 3 |
CAN |
Character encoding: UTF-8 |
APPENDIX IIa:File Format for Beef Pedigree
File Format for Pedigree Delivery to the Interbull Centre for Interbeef Evaluation |
|||
Starting position |
Field |
Format |
Example |
1 |
Record type1 |
Character 3 |
601 |
|
International ID of ANIMAL |
|
|
5 |
Breed of animal 2 |
character 3 |
CHA |
8 |
Country of first registration of animal3 |
character 3 |
DNK |
11 |
Sex |
character 1 |
F |
12 |
ID number of animal4 |
character 12 |
008795005065 |
|
|
|
|
|
International ID of Sire of ANIMAL |
|
|
25 |
Breed of sire of animal 2 |
character 3 |
CHA |
28 |
Country of first registration of sire of animal3 |
character 3 |
DNK |
31 |
Sex |
character 1 |
M |
32 |
ID number of sire of animal4 |
character 12 |
654789321852 |
|
|
|
|
|
International ID of Dam of ANIMAL |
|
|
45 |
Breedof dam of animal 2 |
character 3 |
CHA |
48 |
Country of first registration of dam of animal3 |
character 3 |
DNK |
51 |
Sex |
character 1 |
F |
52 |
ID number of dam of animal4 |
character 12 |
852147963753 |
65 |
Birth date of animal (YYYYMMDD) |
integer 8 |
19861223 |
74 |
Name of animal6 |
character 30 |
CHANTAL |
105 |
Country sending information |
character 3 |
DNK |
Character encoding: UTF-8 |
APPENDIX III: Format File202 Correcting Internationa ID by the Authoritative Organization
(Creates Cross-reference links, valid for dairy and beef users) Field description Label Format Start length Comments Record Type Rec ASCII 1 3 202 Wrong/Alias IID W_AIID ASCII 5 19 usual structure of IID Correct IID R_AIID ASCII 25 19 usual structure of IID Character encoding: UTF-8
APPENDIX IV: Request of Pedigree for Authoritative Organization
Field description |
Label |
Format |
Start |
length |
Comments |
Record Type |
Rec |
ASCII |
1 |
3 |
201 |
Animal IID |
A_IID |
ASCII |
5 |
19 |
usual structure of IID |
Sire IID |
S_IID |
ASCII |
25 |
19 |
usual structure of IID |
Dam IID |
D_IID |
ASCII |
45 |
19 |
usual structure of IID |
Animal Birthdate |
A_BDATE |
yyyymmdd |
65 |
8 |
Date format |
Animal Name |
A_NAME |
ASCII |
74 |
30 |
|
Reporting Organization |
A_RC |
ASCII |
116 |
3 |
Organization providing the data |
Breed composition |
A_breedcomp |
ASCII |
120 |
8 |
To be left blank for the time being. |
Character encoding: UTF-8 |
APPENDIX V: Corrected Foreign Animals
Each record line is separated from the next by a ‘\n’ Field description Label Format Start length Comments Reported IID R_IID ASCII 1 19 usual structure of IID Official Animal IID A_IID ASCII 20 38 usual structure of IID Sire IID S_IID ASCII 39 57 usual structure of IID Dam IID D_IID ASCII 58 76 usual structure of IID Animal Birthdate A_BDATE yyyymmdd 77 8 Date format Animal Name A_NAME ASCII 85 30 Character encoding: UTF-8
APPENDIX VI: FREQUENTLY ASKED QUESTIONS
Q. How do I know that the pedigree file I have submitted has been successfully uploaded into the database?
A. You will receive a confirmation email with some information on the data you have uploaded, i.e. total number of records and number of records validated by default, i.e. number of new domestic animals you have uploaded.The time of receiving the email depends on the size of the pedigree you have uploaded. If the size of the file is ≤100 kb it gets uploaded in real time and you will shortly after receive the confirmation email. If the size of the file is ≥100 kb it gets uploaded during Swedish night hours as the process requires more time. In that case you will receive a confirmation email the next morning, containing the above mentioned information.You are kindly asked to notify the Interbull staff if you have not received any emails 24 hours after uploading of the file.
Q. What is the difference between “Overview of verified/unverified animals.." and "Summary of animals waiting for verification..."?
A. In the first statistic you can see how the verification process is proceeding on your foreign animals. In the second statistic you get an overview of how many animals reported by other organizations are still waiting for your verification.
Q. How do I know if I have any animal to verify?
A. By clicking on “Statistic/Overview of verified/unverified animals” the table will show you the number of animals you need to verify and their reporting country.
Q. What do I do if I have animals pending verification?
A. Download from the main menu the request of pedigree file. For each of the animal listed in the file you need to provide pedigree information as they appear in your own database and upload them using a file200 format previously checked by CheckPedigree.pl. If you notice that the IID of the animals is wrong or is an alias ID then you also have to submit a file202.
Q. What I have to do if some IIDs listed in the request of pedigree cannot be found in my own database?
A. In this case you only have to submit a file202 with 19 “U”s (i.e. UUUUUUUUUUUUUUUUUUU) in the correct IID field.
Q. What do I do if I notice that an animal has been reported using a cross-reference ID instead than the official IID?
A. Provide the pedigree information for that animal as it appears in your own database using a file200 previously checked by CheckPedigree.pl and also provide a file202 putting the correct official IID in the correct IID field.
Q. Can the actual system distinguish between ID formally correct but written in a different format and the real wrong ID?
A. Anytime the authoritative organization provides a file202 the “wrong/alias ID” gets stored in a particular table called “alternative scheme table”. The system does not distinguish between “formally correct” or “real wrong” IDs. The system is built on the principle that every ID is considered as potentially wrong until it gets validated by the authoritative organization. If an authoritative organization provides a “correct ID” (cross-reference link, file202) it means that the ID provided by the reporting organization was not entirely correct so it gets replaced with the one provided by the authoritative organization. The information provided by the reporting country is not lost but stored in the alternative scheme table. In case the ID reported in the correct field is represented by the unknown ID (i.e. 19 “U”s) then that ID is treated as “real wrong” and placed in the limbo space.
Q. Can I download pedigree information from the interface?
A. After every evaluation you will be able to download the international pedigree for the breeds evaluated at the Centre and for which you participate to the Interbull evaluation.