Bio::Tools EUtilities
SummaryIncluded librariesPackage variablesSynopsisDescriptionGeneral documentationMethods
Toolbar
WebCvs
Summary
Bio::Tools::EUtilities - NCBI eutil XML parsers
Package variables
Privates (from "my" definitions)
%VALID_ITERATORS = ( 'globalqueries' => 'globalqueries', 'fieldinfo' => 'fieldinfo', 'fieldinfos' => 'fieldinfo', 'linkinfo' => 'linkinfo', 'linkinfos' => 'linkinfo', 'linksets' => 'linksets', 'docsums' => 'docsums', 'histories' => 'histories' )
%DATA_MODULE = ( 'esearch' => 'Query', 'egquery' => 'Query', 'espell' => 'Query', 'epost' => 'Query', 'elink' => 'Link', 'einfo' => 'Info', 'esummary' => 'Summary', )
%EUTIL_DATA = ( 'esummary' => [qw(DocSum Item)], 'epost' => [], 'egquery' => [], 'einfo' => [qw(Field Link)], 'elink' => [qw(LinkSet LinkSetDb LinkSetDbHistory IdUrlSet Id IdLinkSet ObjUrl Link LinkInfo)], 'espell' => [qw(Original Replaced)], 'esearch' => [qw(Id ErrorList WarningList)], )
%HANDLER = ( 'DocSum' => 1, 'FieldInfo' => 1, 'LinkInfo' => 1, 'GlobalQuery' => 1, 'LinkSet' => 1, 'all' => 1, )
Included modules
XML::Simple
Inherit
Bio::Root::IO Bio::Tools::EUtilities::EUtilDataI
Synopsis
  # from file or fh
my $parser = Bio::Tools::EUtilities->new(
-eutil => 'einfo',
-file => 'output.xml'
);

# or HTTP::Response object...
my $parser = Bio::Tools::EUtilities->new(
-eutil => 'esearch',
-response => $response
);
# esearch, esummary, elink
@ids = $parser->get_ids(); # returns array or array ref of IDs
# egquery, espell $term = $parser->get_term(); # returns array or array ref of IDs # elink, einfo $db = $parser->get_database(); # returns database # Query-related methods (esearch, egquery, espell data) # eutil data centered on use of search terms my $ct = $parser->get_count; # uses optional database for egquery count my $translation = $parser->get_count; my $corrected = $parser->get_corrected_query; # espell while (my $gquery = $parser->next_GlobalQuery) { # iterates through egquery data } # Info-related methods (einfo data) # database-related information my $desc = $parser->get_description; my $update = $parser->get_last_update; my $nm = $parser->get_menu_name; my $ct = $parser->get_record_count; while (my $field = $parser->next_FieldInfo) { # ... } while (my $field = $parser->next_LinkInfo) { # ... } # History methods (epost data, some data returned from elink) # data which enables one to retrieve and query against user-stored # information on the NCBI server while (my $cookie = $parser->next_History) { # ... } my @hists = $parser->get_Histories; # Bio::Tools::EUtilities::Summary (esummary data) # information on a specific database record # retrieve nested docsum data while (my $docsum = $parser->next_DocSum) { print "ID:",$docsum->get_ids,"\n"; while (my $item = $docsum->next_Item) { # do stuff here... while (my $listitem = $docsum->next_ListItem) { # do stuff here... while (my $listitem = $docsum->next_Structure) { # do stuff here... } } } } # retrieve flattened item list per DocSum while (my $docsum = $parser->next_DocSum) { my @items = $docsum->get_all_DocSum_Items; }
Description
Parses NCBI eutils XML output for retrieving IDs and other information. Part of
the BioPerl EUtilities system.
This is a general parser for eutils XML; data from efetch is NOT parsed (this
requires separate format-dependent parsers). All other XML for eutils is parsed.
These modules can be used independently of Bio::DB::EUtilities and
Bio::Tools::EUtilities::EUtilParameters; if used in this way, only data present
in the XML will be parsed out (other bits are retrieved from a passed-in
Bio::Tools::EUtilities::EUtilParameters instance used while querying the
database)
Methods
newDescriptionCode
_initialize
No description
Code
cache_responseDescriptionCode
responseDescriptionCode
parameter_baseDescriptionCode
data_parsedDescriptionCode
is_lazyDescriptionCode
parse_dataDescriptionCode
parse_chunk
No description
Code
to_stringDescriptionCode
print_allDescriptionCode
get_idsDescriptionCode
get_databaseDescriptionCode
get_dbDescriptionCode
get_databasesDescriptionCode
get_dbsDescriptionCode
next_HistoryDescriptionCode
next_cookieDescriptionCode
get_HistoriesDescriptionCode
get_countDescriptionCode
get_termDescriptionCode
get_translation_fromDescriptionCode
get_translation_toDescriptionCode
get_retstartDescriptionCode
get_retmaxDescriptionCode
get_query_translationDescriptionCode
get_corrected_queryDescriptionCode
get_replaced_termsDescriptionCode
next_GlobalQueryDescriptionCode
get_GlobalQueriesDescriptionCode
print_GlobalQueriesDescriptionCode
next_DocSumDescriptionCode
get_DocSumsDescriptionCode
print_DocSumsDescriptionCode
get_available_databasesDescriptionCode
get_record_countDescriptionCode
get_last_updateDescriptionCode
get_menu_nameDescriptionCode
get_descriptionDescriptionCode
next_FieldInfoDescriptionCode
get_FieldInfoDescriptionCode
next_LinkInfoDescriptionCode
get_LinkInfoDescriptionCode
print_FieldInfoDescriptionCode
print_LinkInfoDescriptionCode
next_LinkSetDescriptionCode
get_LinkSetsDescriptionCode
print_LinkSetsDescriptionCode
get_linked_databasesDescriptionCode
rewindDescriptionCode
generate_iteratorDescriptionCode
callbackDescriptionCode
_print_handler
No description
Code
_seekable
No description
Code
_fix_espell
No description
Code
_load_eutil_module
No description
Code
Methods description
newcode    nextTop
 Title    : new
Usage : my $parser = Bio::Tools::EUtilities->new(-file => 'my.xml',
-eutil => 'esearch');
Function : create Bio::Tools::EUtilities instance
Returns : new Bio::Tools::EUtilities instance
Args : -file/-fh - File or filehandle
-eutil - eutil parser to use (supports all but efetch)
-response - HTTP::Response object (optional)
cache_responsecodeprevnextTop
 Title    : cache_response
Usage : $parser->cache_response(1)
Function : sets flag to cache response object (off by default)
Returns : value eval'ing to TRUE or FALSE
Args : value eval'ing to TRUE or FALSE
Note : must be set prior to any parsing run
responsecodeprevnextTop
 Title    : response
Usage : my $response = $parser->response;
Function : Get/Set HTTP::Response object
Returns : HTTP::Response
Args : HTTP::Response
Note : to prevent object from destruction set cache_response() to TRUE
parameter_basecodeprevnextTop
 Title    : parameter_base
Usage : my $response = $parser->parameter_base;
Function : Get/Set Bio::ParameterBaseI object (should be Bio::Tools::EUtilities::EUtilParameters)
Returns : Bio::Tools::EUtilities::EUtilParameters || undef
Args : (optional) Bio::Tools::EUtilities::EUtilParameters
Note : If this object is present, it may be used as a last resort for
some data values if parsed XML does not contain said values (for
instance, database, term, IDs, etc).
data_parsedcodeprevnextTop
 Title    : data_parsed
Usage : if ($parser->data_parsed) {...}
Function : returns TRUE if data has been parsed
Returns : value eval'ing to TRUE or FALSE
Args : none (set within parser)
Note : mainly internal method (set in case user wants to check
whether parser is exhausted).
is_lazycodeprevnextTop
 Title    : is_lazy
Usage : if ($parser->is_lazy) {...}
Function : returns TRUE if parser is set to lazy parsing mode
(only affects elink/esummary)
Returns : Boolean
Args : none
Note : Permanently set in constructor. Still highly experimental.
Don't stare directly at happy fun ball...
parse_datacodeprevnextTop
 Title    : parse_data
Usage : $parser->parse_data
Function : direct call to parse data; normally implicitly called
Returns : none
Args : none
to_stringcodeprevnextTop
 Title    : to_string
Usage : $foo->to_string()
Function : converts current object to string
Returns : none
Args : (optional) simple data for text formatting
Note : Implemented in plugins
print_allcodeprevnextTop
 Title    : print_all
Usage : $info->print_all();
$info->print_all(-fh => $fh, -cb => $coderef);
Function : prints (dumps) all data in parser. Unless a coderef is supplied,
this just dumps the parser-specific to_string method to either a
file/fh or STDOUT
Returns : none
Args : [optional]
-file : file to print to
-fh : filehandle to print to (cannot be used concurrently with file)
-cb : coderef to use in place of default print method. This is
passed in the parser object
-wrap : number of columns to wrap default text output to (def = 80)
Notes : only applicable for einfo. If -file or -fh are not defined,
prints to STDOUT
get_idscodeprevnextTop
 Title    : get_ids
Usage : my @ids = $parser->get_ids
Function : returns array of requested IDs (see Notes for more specifics)
Returns : array
Args : [conditional] not required except when running elink queries against
multiple databases. In case of the latter, the database name is
optional but recommended when retrieving IDs as the ID list will
be globbed together. In such cases, if a db name isn't provided a
warning is issued as a reminder.
Notes : esearch : returned ID list
elink : returned ID list (see Args above for caveats)
all others : from parameter_base->id or undef
get_databasecodeprevnextTop
 Title    : get_database
Usage : my $db = $info->get_database;
Function : returns single database name (eutil-compatible). This is the
queried database. For most eutils this is straightforward. For
elinks (which have 'db' and 'dbfrom') this is db/dbto, for egquery,
it is the first db in the list (you probably want get_databases
instead)
Returns : string
Args : none
Notes : egquery : first db in the query (you probably want get_databases)
einfo : the queried database
espell : the queried database
all others : from parameter_base->db or undef
get_db (alias for get_database)codeprevnextTop
get_databasescodeprevnextTop
 Title    : get_databases
Usage : my @dbs = $parser->get_databases
Function : returns list of databases
Returns : array of strings
Args : none
Notes : This is guaranteed to return a list of databases. For a single
database use the convenience method get_db/get_database

egquery : list of all databases in the query
einfo : the queried database, or the available databases
espell : the queried database
elink : collected from each LinkSet
all others : from parameter_base->db or undef
get_dbs (alias for get_databases)codeprevnextTop
next_HistorycodeprevnextTop
 Title    : next_History
Usage : while (my $hist=$parser->next_History) {...}
Function : returns next HistoryI (if present).
Returns : Bio::Tools::EUtilities::HistoryI (Cookie or LinkSet)
Args : none
Note : esearch, epost, and elink are all capable of returning data which
indicates search results (in the form of UIDs) is stored on the
remote server. Access to this data is wrapped up in simple interface
(HistoryI), which is implemented in two classes:
Bio::DB::EUtilities::History (the simplest) and
Bio::DB::EUtilities::LinkSet. In general, calls to epost and esearch
will only return a single HistoryI object (formerly known as a
Cookie), but calls to elink can generate many depending on the
number of IDs, the correspondence, etc. Hence this iterator, which
allows one to retrieve said data one piece at a time.
next_cookie (alias for next_History)codeprevnextTop
get_HistoriescodeprevnextTop
 Title    : get_Histories
Usage : my @hists = $parser->get_Histories
Function : returns list of HistoryI objects.
Returns : list of Bio::Tools::EUtilities::HistoryI (History or LinkSet)
Args : none
get_countcodeprevnextTop
 Title    : get_count
Usage : my $ct = $parser->get_count
Function : returns the count (hits for a search)
Returns : integer
Args : [CONDITIONAL] string with database name - used to retrieve
count from specific database when using egquery
Notes : egquery : count for specified database (specified above)
esearch : count for last search
all others : undef
get_termcodeprevnextTop
 Title    : get_term
Usage : $st = $qd->get_term;
Function : retrieve the term for the global search
Returns : string
Args : none
Notes : egquery : search term
espell : search term
esearch : from parameter_base->term or undef
all others : undef
get_translation_fromcodeprevnextTop
 Title   : get_translation_from
Usage : $string = $qd->get_translation_from();
Function: portion of the original query replaced with translated_to()
Returns : string
Args : none
Note : only applicable for esearch
get_translation_tocodeprevnextTop
 Title   : get_translation_to
Usage : $string = $qd->get_translation_to();
Function: replaced string used in place of the original query term in translation_from()
Returns : string
Args : none
Note : only applicable for esearch
get_retstartcodeprevnextTop
 Title    : get_retstart
Usage : $start = $qd->get_retstart();
Function : retstart setting for the query (either set or NCBI default)
Returns : Integer
Args : none
Notes : esearch : retstart
esummary : retstart
all others : from parameter_base->retstart or undef
get_retmaxcodeprevnextTop
 Title    : get_retmax
Usage : $max = $qd->get_retmax();
Function : retmax setting for the query (either set or NCBI default)
Returns : Integer
Args : none
Notes : esearch : retmax
esummary : retmax
all others : from parameter_base->retmax or undef
get_query_translationcodeprevnextTop
 Title   : get_query_translation
Usage : $string = $qd->get_query_translation();
Function: returns the translated query used for the search (if any)
Returns : string
Args : none
Notes : only applicable for esearch. This is the actual term used for
esearch.
get_corrected_querycodeprevnextTop
 Title    : get_corrected_query
Usage : my $cor = $eutil->get_corrected_query;
Function : retrieves the corrected query when using espell
Returns : string
Args : none
Notes : only applicable for espell.
get_replaced_termscodeprevnextTop
 Title    : get_replaced_terms
Usage : my $term = $eutil->get_replaced_terms
Function : returns array of strings replaced in the query
Returns : string
Args : none
Notes : only applicable for espell
next_GlobalQuerycodeprevnextTop
 Title    : next_GlobalQuery
Usage : while (my $query = $eutil->next_GlobalQuery) {...}
Function : iterates through the queries returned from an egquery search
Returns : GlobalQuery object
Args : none
Notes : only applicable for egquery
get_GlobalQueriescodeprevnextTop
 Title    : get_GlobalQueries
Usage : @queries = $eutil->get_GlobalQueries
Function : returns list of GlobalQuery objects
Returns : array of GlobalQuery objects
Args : none
Notes : only applicable for egquery
print_GlobalQueriescodeprevnextTop
 Title    : print_GlobalQueries
Usage : $docsum->print_GlobalQueries();
$docsum->print_GlobalQueries(-fh => $fh, -callback => $coderef);
Function : prints item data for all global queries. The default printing
method is each item per DocSum is printed with relevant values if
present in a simple table using Text::Wrap.
Returns : none
Args : [optional]
-file : file to print to
-fh : filehandle to print to (cannot be used concurrently with file)
-cb : coderef to use in place of default print method. This is passed
in a GlobalQuery object;
-wrap : number of columns to wrap default text output to (def = 80)
Notes : only applicable for esummary. If -file or -fh are not defined,
prints to STDOUT
next_DocSumcodeprevnextTop
 Title    : next_DocSum
Usage : while (my $ds = $esum->next_DocSum) {...}
Function : iterate through DocSum instances
Returns : single Bio::Tools::EUtilities::Summary::DocSum
Args : none yet
Notes : only applicable for esummary
get_DocSumscodeprevnextTop
 Title    : get_DocSums
Usage : my @docsums = $esum->get_DocSums
Function : retrieve a list of DocSum instances
Returns : array of Bio::Tools::EUtilities::Summary::DocSum
Args : none
Notes : only applicable for esummary
print_DocSumscodeprevnextTop
 Title    : print_DocSums
Usage : $docsum->print_DocSums();
$docsum->print_DocSums(-fh => $fh, -cb => $coderef);
Function : prints item data for all docsums. The default data is generated
via DocSum::to_string
Returns : none
Args : [optional]
-file : file to print to
-fh : filehandle to print to (cannot be used concurrently with file)
-cb : coderef to use in place of default print method. This is passed
in a DocSum object
-wrap : number of columns to wrap default text output to (def = 80)
Notes : only applicable for esummary. If -file or -fh are not defined,
prints to STDOUT
get_available_databasescodeprevnextTop
 Title    : get_available_databases
Usage : my @dbs = $info->get_available_databases
Function : returns list of available eutil-compatible database names
Returns : Array of strings
Args : none
Notes : only applicable for einfo.
get_record_countcodeprevnextTop
 Title    : get_record_count
Usage : my $ct = $eutil->get_record_count;
Function : returns database record count
Returns : integer
Args : none
Notes : only applicable for einfo.
get_last_updatecodeprevnextTop
 Title    : get_last_update
Usage : my $time = $info->get_last_update;
Function : returns string containing time/date stamp for last database update
Returns : integer
Args : none
Notes : only applicable for einfo.
get_menu_namecodeprevnextTop
 Title    : get_menu_name
Usage : my $nm = $info->get_menu_name;
Function : returns string of database menu name
Returns : string
Args : none
Notes : only applicable for einfo.
get_descriptioncodeprevnextTop
 Title    : get_description
Usage : my $desc = $info->get_description;
Function : returns database description
Returns : string
Args : none
Notes : only applicable for einfo.
next_FieldInfocodeprevnextTop
 Title    : next_FieldInfo
Usage : while (my $field = $info->next_FieldInfo) {...}
Function : iterate through FieldInfo objects
Returns : Field object
Args : none
Notes : only applicable for einfo. Uses callback() for filtering if defined
for 'fields'
get_FieldInfocodeprevnextTop
 Title    : get_FieldInfo
Usage : my @fields = $info->get_FieldInfo;
Function : returns list of FieldInfo objects
Returns : array (FieldInfo objects)
Args : none
Notes : only applicable for einfo.
next_LinkInfocodeprevnextTop
 Title    : next_LinkInfo
Usage : while (my $link = $info->next_LinkInfo) {...}
Function : iterate through LinkInfo objects
Returns : LinkInfo object
Args : none
Notes : only applicable for einfo. Uses callback() for filtering if defined
for 'linkinfo'
get_LinkInfocodeprevnextTop
 Title    : get_LinkInfo
Usage : my @links = $info->get_LinkInfo;
Function : returns list of LinkInfo objects
Returns : array (LinkInfo objects)
Args : none
Notes : only applicable for einfo.
print_FieldInfocodeprevnextTop
 Title    : print_FieldInfo
Usage : $info->print_FieldInfo();
$info->print_FieldInfo(-fh => $fh, -cb => $coderef);
Function : prints link data for each FieldInfo object. The default is generated
via FieldInfo::to_string
Returns : none
Args : [optional]
-file : file to print to
-fh : filehandle to print to (cannot be used concurrently with file)
-cb : coderef to use in place of default print method. This is
passed in a FieldInfo object
-wrap : number of columns to wrap default text output to (def = 80)
Notes : only applicable for einfo. If -file or -fh are not defined,
prints to STDOUT
print_LinkInfocodeprevnextTop
 Title    : print_LinkInfo
Usage : $info->print_LinkInfo();
$info->print_LinkInfo(-fh => $fh, -cb => $coderef);
Function : prints link data for each LinkInfo object. The default is generated
via LinkInfo::to_string
Returns : none
Args : [optional]
-file : file to print to
-fh : filehandle to print to (cannot be used concurrently with file)
-cb : coderef to use in place of default print method. This is passed
in a LinkInfo object
-wrap : number of columns to wrap default text output to (def = 80)
Notes : only applicable for einfo. If -file or -fh are not defined,
prints to STDOUT
next_LinkSetcodeprevnextTop
 Title    : next_LinkSet
Usage : while (my $ls = $eutil->next_LinkSet {...}
Function : iterate through LinkSet objects
Returns : LinkSet object
Args : none
Notes : only applicable for elink. Uses callback() for filtering if defined
for 'linksets'
get_LinkSetscodeprevnextTop
 Title    : get_LinkSets
Usage : my @links = $info->get_LinkSets;
Function : returns list of LinkSets objects
Returns : array (LinkSet objects)
Args : none
Notes : only applicable for elink.
print_LinkSetscodeprevnextTop
 Title    : print_LinkSets
Usage : $info->print_LinkSets();
$info->print_LinkSets(-fh => $fh, -cb => $coderef);
Function : prints link data for each LinkSet object. The default is generated
via LinkSet::to_string
Returns : none
Args : [optional]
-file : file to print to
-fh : filehandle to print to (cannot be used concurrently with file)
-cb : coderef to use in place of default print method. This is passed
in a LinkSet object
-wrap : number of columns to wrap default text output to (def = 80)
Notes : only applicable for einfo. If -file or -fh are not defined,
prints to STDOUT
get_linked_databasescodeprevnextTop
 Title    : get_linked_databases
Usage : my @dbs = $eutil->get_linked_databases
Function : returns list of databases linked to in linksets
Returns : array of databases
Args : none
Notes : only applicable for elink. Now defers to get_databases.
rewindcodeprevnextTop
 Title    : rewind
Usage : $esum->rewind()
$esum->rewind('recursive')
Function : retrieve a list of DocSum instances
Returns : array of Bio::Tools::EUtilities::Summary::DocSum
Args : [optional] Scalar; string ('all') to reset all iterators, or string
describing the specific main object iterator to reset. The following
are recognized (case-insensitive):
'all' - rewind all objects and also recursively resets nested object interators (such as LinkSets and DocSums). 'globalqueries' - GlobalQuery objects 'fieldinfo' or 'fieldinfos' - FieldInfo objects 'linkinfo' or 'linkinfos' - LinkInfo objects in this layer 'linksets' - LinkSet objects 'docsums' - DocSum objects 'histories' - HistoryI objects (Cookies, LinkSets)
generate_iteratorcodeprevnextTop
 Title    : generate_iterator
Usage : my $coderef = $esum->generate_iterator('linkinfo')
Function : generates an iterator (code reference) which iterates through
the relevant object indicated by the args
Returns : code reference
Args : [REQUIRED] Scalar; string describing the specific object to iterate.
The following are currently recognized (case-insensitive):
'globalqueries' 'fieldinfo' or 'fieldinfos' (the latter sounds clumsy, but I alias it JIC) 'linkinfo' or 'linkinfos' (the latter sounds clumsy, but I alias it JIC) 'linksets' 'docsums' 'histories' Note : This function generates a simple coderef that one can use independently of the various next_* functions (in fact, the next_* functions use lazily created iterators generated via this method, while rewind() merely deletes them so they can be regenerated on the next call). A callback specified using callback() will be used to filter objects for any generated iterator. This behaviour is implemented for both normal and lazy iterator types and is the default. If you don't want this, make sure to reset any previously set callbacks via reset_callback() (which just deletes the code ref). Note that setting callback() also changes the behavior of the next_* functions as the iterators are generated here (as described above); this is a feature and not a bug. 'Lazy' iterators are considered an experimental feature and may be modified in the future. A 'lazy' iterator, which loops through and returns objects as they are created (instead of creating all data instances up front, then iterating through) is returned if the parser is set to 'lazy' mode. This mode is only present for elink and esummary output as they are the two formats parsed which can generate potentially thousands of individual objects (note efetch isn't parsed, so isn't counted). Use of rewind() with these iterators is not supported for the time being as we can't guarantee you can rewind(), as this depends on whether the data source is seek()able and thus 'rewindable'. We will add rewind() support at a later time which will work for 'seekable' data or possibly cached objects via Storable or BDB.
callbackcodeprevnextTop
 Title    : callback
Usage : $parser->callback(sub {$_[0]->get_database eq 'protein'});
Function : Get/set callback code ref used to filter returned data objects
Returns : code ref if previously set
Args : single argument:
code ref - evaluates a passed object and returns true or false value
(used in iterators)
'reset' - string, resets the iterator.
returns upon any other args
Methods code
newdescriptionprevnextTop
sub new {
    my($caller,@args) = @_;
    my $class = ref $caller || $caller;
    if ($class =~ m{Bio::Tools::EUtilities::(\S+)}) {
        my ($self) = $class->SUPER::new(@args);
        $self->_initialize(@args);
        return $self;
    } else {
        my %param = @args;
		@param{ map { lc $_ } keys %param } = values %param; # lowercase keys
my $eutil = $param{'-eutil'} || $class->throw("Need eutil to make instance"); return unless( $class->_load_eutil_module( $DATA_MODULE{$eutil}) ); return "Bio::Tools::EUtilities::$DATA_MODULE{$eutil}"->new(-datatype => lc $DATA_MODULE{$eutil}, -eutil => $eutil, @args); }
}
_initializedescriptionprevnextTop
sub _initialize {
    my ($self, @args) = @_;
    my ($response, $pobj, $type, $eutil, $cache, $lazy) =
    $self->_rearrange([qw(RESPONSE
                       PARAMETERS
                       DATATYPE
                       EUTIL
                       CACHE_RESPONSE
                       LAZY)], @args);
    $lazy ||= 0;
    $cache ||= 0;
    $self->datatype($type);
    $self->eutil($eutil);
    # lazy parsing only implemented for elink and esummary (where returned data
# can be quite long). Also, no point to parsing lazily when the data is
# already in memory in an HTTP::Response object, so turn it off and chunk
# the Response object after parsing.
$response && $self->response($response); $pobj && $self->parameter_base($pobj); $self->cache_response($cache); $lazy = 0 if ($response) || ($eutil ne 'elink' && $eutil ne 'esummary'); # setting parser to 'lazy' mode is permanent (can't reset later)
$self->{'_lazy'} = $lazy; $self->{'_parsed'} = 0; }
}
cache_responsedescriptionprevnextTop
sub cache_response {
    my ($self, $cache) = @_;
    if (defined $cache) {
        $self->{'_cache_response'} = ($cache) ? 1 : 0;
    }
    return $self->{'_cache_response'};
}
responsedescriptionprevnextTop
sub response {
    my ($self, $response) = @_;
    if ($response) {
        $self->throw('Not an HTTP::Response object') unless (ref $response && $response->isa('HTTP::Response'));
        $self->{'_response'} = $response; 
    }
    return $self->{'_response'};
}
parameter_basedescriptionprevnextTop
sub parameter_base {
    my ($self, $pb) = @_;
    if ($pb) {
        $self->throw('Not an Bio::ParameterBaseI object') unless (ref $pb && $pb->isa('Bio::ParameterBaseI'));
        $self->warn('Not an Bio::Tools::EUtilities::EUtilParameters object; may experience some turbulence...') unless (ref $pb && $pb->isa('Bio::Tools::EUtilities::EUtilParameters'));
        $self->{'_parameter_base'} = $pb; 
    }
    return $self->{'_parameter_base'};
}
data_parseddescriptionprevnextTop
sub data_parsed {
    return shift->{'_parsed'};
}
is_lazydescriptionprevnextTop
sub is_lazy {
    return shift->{'_lazy'};
}
parse_datadescriptionprevnextTop
sub parse_data {
    my $self = shift;
    my $eutil = $self->eutil;
    my $xs = XML::Simple->new();
    my $response = $self->response ? $self->response :
                   $self->_fh      ? $self->_fh      :
        $self->throw('No response or stream specified');
    my $simple = ($eutil eq 'espell') ?
            $xs->XMLin($self->_fix_espell($response), forcearray => $EUTIL_DATA{$eutil}) :
        ($response && $response->isa("HTTP::Response")) ?
            $xs->XMLin($response->content, forcearray => $EUTIL_DATA{$eutil}) :
            $xs->XMLin($response, forcearray => $EUTIL_DATA{$eutil});
    # check for errors
if ($simple->{ERROR}) { my $error = $simple->{ERROR}; $self->throw("NCBI $eutil fatal error: ".$error) unless ref $error; } if ($simple->{InvalidIdList}) { $self->warn("NCBI $eutil error: Invalid ID List".$simple->{InvalidIdList}); return; } if ($simple->{ErrorList} || $simple->{WarningList}) { my @errorlist = @{ $simple->{ErrorList} } if $simple->{ErrorList}; my @warninglist = @{ $simple->{WarningList} } if $simple->{WarningList}; my ($err_warn); for my $error (@errorlist) { my $messages = join("\n\t",map {"$_ [".$error->{$_}.']'} grep {!ref $error->{$_}} keys %$error); $err_warn .= "Error : $messages"; } for my $warn (@warninglist) { my $messages = join("\n\t",map {"$_ [".$warn->{$_}.']'} grep {!ref $warn->{$_}} keys %$warn); $err_warn .= "Warnings : $messages"; } chomp($err_warn); $self->warn("NCBI $eutil Errors/Warnings:\n".$err_warn) # don't return as some data may still be useful
} delete $self->{'_response'} unless $self->cache_response; $self->{'_parsed'} = 1; $self->_add_data($simple); } # implemented only for elink/esummary, still experimental
}
parse_chunkdescriptionprevnextTop
sub parse_chunk {
    my $self = shift;
    my $eutil = $self->eutil;
    my $tag = $eutil eq 'elink'    ? 'LinkSet' :
              $eutil eq 'esummary' ? 'DocSum'  :
              $self->throw("Only eutil elink/esummary use parse_chunk()");
    my $xs = XML::Simple->new();
    if ($self->response) {
        $self->throw("Lazy parsing not implemented for HTTP::Response data yet");
        delete $self->{'_response'} if !$self->cache_response && $self->data_parsed;
    } else { # has to be a file/filehandle
my $fh = $self->_fh; my ($chunk, $seendoc, $line); CHUNK: while ($line = <$fh>) { next unless $seendoc || $line =~ m{^<$tag>}; $seendoc = 1; $chunk .= $line; last if $line =~ m{^</$tag>}; } if (!defined $line) { $self->{'_parsed'} = 1; return; } $self->_add_data( $xs->XMLin($chunk, forcearray => $EUTIL_DATA{$eutil}, KeepRoot => 1) ); } }
}
to_stringdescriptionprevnextTop
sub to_string {
    my $self = shift;
    $self->parse_data if ($self->can('parse_data') && !$self->data_parsed);
    return sprintf("%-20s:%s\n\n", 'EUtil', $self->eutil);
}
print_alldescriptionprevnextTop
sub print_all {
    my ($self, @args) = @_;
    $self->_print_handler(@args);
}
get_idsdescriptionprevnextTop
sub get_ids {
    my ($self, $request) = @_;
    my $eutil = $self->eutil;
    if ($self->is_lazy) {
        $self->warn('get_ids() not implemented when using lazy mode');
        return;
    }
    $self->parse_data unless $self->data_parsed;
    if ($eutil eq 'esearch') {
        return $self->{'_id'} ? @{ $self->{'_id'} } : ();
    } elsif ($eutil eq 'elink')  {
        my @ids;
        if ($request) {
            if (ref $request eq 'CODE') {
                push @ids, map {$_->get_ids }
                    grep { $request->($_) } $self->get_LinkSets;
            } else {
                push @ids,
                    map { @{$_->[0]} }
                    grep {grep { $_ eq $request } @{$_->[1]}}
                    map {[[$_->get_ids], [$_->get_databases]]} $self->get_LinkSets;
            }
        } else {
            $self->warn('Multiple database present, IDs will be globbed together')
                if $self->get_linked_databases > 1;
            push @ids, map {$_->get_ids } $self->get_LinkSets;
        }
        return @ids;
    } elsif ($eutil eq 'esummary') {
        unless (exists $self->{'_id'}) {
            push @{$self->{'_id'}}, map {$_->get_id } $self->get_DocSums;
        }
        return @{$self->{'_id'}};
    } elsif (my $pb = $self->parameter_base) {
        my $ids = $pb->id;
        return $ids ? @{$ids} : ();
    } else {
        return ()
    }
}
get_databasedescriptionprevnextTop
sub get_database {
    return ($_[0]->get_databases)[0];
}
get_dbdescriptionprevnextTop
sub get_db {
    return shift->get_database;
}
get_databasesdescriptionprevnextTop
sub get_databases {
    my ($self, $db) = @_;
    $self->parse_data unless $self->data_parsed;
    my $eutil = $self->eutil;
    my @dbs;
    if ($eutil eq 'einfo' || $eutil eq 'espell') {
        @dbs = $self->{'_dbname'} ||
        $self->{'_database'} ||
        $self->get_available_databases;
    } elsif ($eutil eq 'egquery') {
        @dbs = map {$_->get_database} ($self->get_GlobalQueries);
    } elsif ($eutil eq 'elink') {
        # only unique dbs
my %tmp; @dbs = sort grep {!$tmp{$_}++} map {($_->get_databases)} $self->get_LinkSets; } elsif ($self->parameter_base) { if ($self->parameter_base->eutil eq 'elink') { @dbs = $self->parameter_base->dbfrom; } else { @dbs = $self->parameter_base->db; } } return @dbs;
}
get_dbsdescriptionprevnextTop
sub get_dbs {
    return shift->get_databases;
}
next_HistorydescriptionprevnextTop
sub next_History {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;    
    $self->{'_histories_it'} = $self->generate_iterator('histories')
        if (!exists $self->{'_histories_it'});
    my $hist =  $self->{'_histories_it'}->();
}
next_cookiedescriptionprevnextTop
sub next_cookie {
    return shift->next_History;
}
get_HistoriesdescriptionprevnextTop
sub get_Histories {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;
    ref $self->{'_histories'} ? return @{ $self->{'_histories'} } : return ();
}
get_countdescriptionprevnextTop
sub get_count {
    my ($self, $db) = @_;
    $self->parse_data unless $self->data_parsed;
    # egquery
if ($self->datatype eq 'multidbquery') { if (!$db) { $self->warn('Must specify database to get count from'); return; } my ($gq) = grep {$_->get_database eq $db} $self->get_GlobalQueries; $gq && return $gq->get_count; $self->warn("Unknown database $db"); return; } else { return $self->{'_count'} || scalar($self->get_ids); }
}
get_termdescriptionprevnextTop
sub get_term {
    my ($self, @args) = @_;
    $self->parse_data unless $self->data_parsed;
    $self->{'_term'}  ? $self->{'_term'}  :
    $self->{'_query'} ? $self->{'_query'} :
    $self->parameter_base ? $self->parameter_base->term :
    return;
}
get_translation_fromdescriptionprevnextTop
sub get_translation_from {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;
    return $self->{'_translation'}->{'From'};
}
get_translation_todescriptionprevnextTop
sub get_translation_to {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;
    return $self->{'_translation'}->{'To'};
}
get_retstartdescriptionprevnextTop
sub get_retstart {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;    
    return $self->{'_retstart'};
}
get_retmaxdescriptionprevnextTop
sub get_retmax {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;    
    return $self->{'_retmax'};
}
get_query_translationdescriptionprevnextTop
sub get_query_translation {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;
    return $self->{'_querytranslation'};
}
get_corrected_querydescriptionprevnextTop
sub get_corrected_query {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;
    return $self->{'_correctedquery'};
}
get_replaced_termsdescriptionprevnextTop
sub get_replaced_terms {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;
    if ($self->{'_spelledquery'} && $self->{'_spelledquery'}->{Replaced}) {
        ref $self->{'_spelledquery'}->{Replaced} ?
        return @{ $self->{'_spelledquery'}->{Replaced} } : return ();
    }
}
next_GlobalQuerydescriptionprevnextTop
sub next_GlobalQuery {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;    
    $self->{'_globalqueries_it'} = $self->generate_iterator('globalqueries')
        if (!exists $self->{'_globalqueries_it'});
    $self->{'_globalqueries_it'}->();
}
get_GlobalQueriesdescriptionprevnextTop
sub get_GlobalQueries {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;
    ref $self->{'_globalqueries'} ? return @{ $self->{'_globalqueries'} } : return ();
}
print_GlobalQueriesdescriptionprevnextTop
sub print_GlobalQueries {
    my ($self, @args) = @_;
    $self->_print_handler(@args, -type => 'GlobalQuery');
}
next_DocSumdescriptionprevnextTop
sub next_DocSum {
    my $self = shift;
    if(!$self->data_parsed && !$self->is_lazy) {
        $self->parse_data;
    }
    $self->{'_docsums_it'} = $self->generate_iterator('docsums')
        if (!exists $self->{'_docsums_it'});
    $self->{'_docsums_it'}->();
}
get_DocSumsdescriptionprevnextTop
sub get_DocSums {
    my $self = shift;
    if ($self->is_lazy) {
        $self->warn('get_DocSums() not implemented when using lazy mode');
        return ();
    }
    $self->parse_data unless $self->data_parsed;
    return ref $self->{'_docsums'} ? @{ $self->{'_docsums'} } : return ();
}
print_DocSumsdescriptionprevnextTop
sub print_DocSums {
    my ($self, @args) = @_;
    $self->_print_handler(@args, -type => 'DocSum');
}
get_available_databasesdescriptionprevnextTop
sub get_available_databases {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;
    ($self->{'_available_databases'}) ?
        return @{($self->{'_available_databases'})} :
        return ();
}
get_record_countdescriptionprevnextTop
sub get_record_count {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;
    return $self->{'_count'}
}
get_last_updatedescriptionprevnextTop
sub get_last_update {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;
    return $self->{'_lastupdate'}
}
get_menu_namedescriptionprevnextTop
sub get_menu_name {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;    
    exists $self->{'_menuname'} ? return $self->{'_menuname'} :
    exists $self->{'_menu'} ? return $self->{'_menu'} :
    return;
}
get_descriptiondescriptionprevnextTop
sub get_description {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;
    return $self->{'_description'};
}
next_FieldInfodescriptionprevnextTop
sub next_FieldInfo {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;    
    $self->{'_fieldinfo_it'} = $self->generate_iterator('fieldinfo')
        if (!exists $self->{'_fieldinfo_it'});
    $self->{'_fieldinfo_it'}->();
}
get_FieldInfodescriptionprevnextTop
sub get_FieldInfo {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;        
    return ref $self->{'_fieldinfo'} ? @{ $self->{'_fieldinfo'} } : return ();
}

*get_FieldInfos =\& get_FieldInfo;
}
next_LinkInfodescriptionprevnextTop
sub next_LinkInfo {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;    
    $self->{'_linkinfo_it'} = $self->generate_iterator('linkinfo')
        if (!exists $self->{'_linkinfo_it'});
    $self->{'_linkinfo_it'}->();
}
get_LinkInfodescriptionprevnextTop
sub get_LinkInfo {
    my $self = shift;
    $self->parse_data unless $self->data_parsed;        
    return ref $self->{'_linkinfo'} ? @{ $self->{'_linkinfo'} } : return ();
}

*get_LinkInfos =\& get_LinkInfo;
}
print_FieldInfodescriptionprevnextTop
sub print_FieldInfo {
    my ($self, @args) = @_;
    $self->_print_handler(@args, -type => 'FieldInfo');
}
print_LinkInfodescriptionprevnextTop
sub print_LinkInfo {
    my ($self, @args) = @_;
    $self->_print_handler(@args, -type => 'LinkInfo');
}
next_LinkSetdescriptionprevnextTop
sub next_LinkSet {
    my $self = shift;
    #$self->parse_data unless $self->data_parsed;
if(!$self->data_parsed && !$self->is_lazy) { $self->parse_data; } $self->{'_linksets_it'} = $self->generate_iterator('linksets') if (!exists $self->{'_linksets_it'}); $self->{'_linksets_it'}->();
}
get_LinkSetsdescriptionprevnextTop
sub get_LinkSets {
    my $self = shift;
    if ($self->is_lazy) {
        $self->warn('get_LinkSets() not implemented when using lazy mode');
        return ();
    }
    $self->parse_data unless $self->data_parsed;
    return ref $self->{'_linksets'} ? @{ $self->{'_linksets'} } : return ();
}
print_LinkSetsdescriptionprevnextTop
sub print_LinkSets {
    my ($self, @args) = @_;
    $self->_print_handler(@args, -type => 'LinkSet');
}
get_linked_databasesdescriptionprevnextTop
sub get_linked_databases {
    my $self = shift;
    return $self->get_databases if $self->eutil eq 'elink';
    return ();
}
rewinddescriptionprevnextTop
sub rewind {
    my ($self, $arg) = ($_[0], lc $_[1]);
    my $eutil = $self->eutil;
    if ($self->is_lazy) {
        $self->warn('rewind() not implemented yet when running in lazy mode');
        return;
    }
    $arg ||= 'all';
    if (exists $VALID_ITERATORS{$arg}) {
        delete $self->{'_'.$arg.'_it'};
    } elsif ($arg eq 'all') {
        for my $it (values %VALID_ITERATORS){
            delete $self->{'_'.$it.'_it'} if
                exists $self->{'_'.$it.'_it'};
            map {$_->rewind('all')} $self->get_LinkSets;
            map {$_->rewind('all')} $self->get_DocSums;
        }
    }
}
generate_iteratordescriptionprevnextTop
sub generate_iterator {
    my ($self, $obj) = @_;
    if (!$obj) {
        $self->throw('Must provide object type to iterate');
    } elsif (!exists $VALID_ITERATORS{$obj}) {
        $self->throw("Unknown object type [$obj]");
    }
    my $cb = $self->callback;
    if ($self->is_lazy) {
        my $type = $self->eutil eq 'esummary' ? '_docsums' : '_linksets';
        $self->{$type} = [];
        return sub {
            if (!@{$self->{$type}}) {
                $self->parse_chunk; # fill the queue
} while (my $obj = shift @{$self->{$type}}) { if ($cb) { ($cb->($obj)) ? return $obj : next; } else { return $obj; } } undef; } } else { my $loc = '_'.$VALID_ITERATORS{$obj}; my $index = $#{$self->{$loc}}; my $current = 0; return sub { while ($current <= $index) { if ($cb) { if (my $d = $cb->($self->{$loc}->[$current])) { return $self->{$loc}->[$current++] } else { $current++; next; } } else { return $self->{$loc}->[$current++] } } undef; } } }
}
callbackdescriptionprevnextTop
sub callback {
    my ($self, $cb) = @_;
    if ($cb) {
        delete $self->{'_cb'} if ($cb eq 'reset');
        return if ref $cb ne 'CODE';
        $self->{'_cb'} = $cb;
    }
    return $self->{'_cb'};
}

# Object printing methods
{ my $DEF_HANDLER = sub { my $obj = shift; return $obj->to_string."\n"; }; my %HANDLER = ( 'DocSum' => 1, 'FieldInfo' => 1, 'LinkInfo' => 1, 'GlobalQuery' => 1, 'LinkSet' => 1, 'all' => 1, );
}
_print_handlerdescriptionprevnextTop
sub _print_handler {
        my $self = shift;
        my ($file, $fh, $cb, $wrap, $type, $all) = $self->_rearrange([qw(FILE FH CB WRAP TYPE ALL)], @_);
        $type ||= 'all';
        
        # default formatting delegates to_string
if (!$cb) { $self->throw("Type $type not registered with print handler, exiting...") if !exists($HANDLER{$type}); $cb = $DEF_HANDLER; } else { $self->throw("Callback must be a code reference") if ref $cb ne 'CODE'; } $file ||= $fh; $self->throw("Have defined both file and filehandle; only use one!") if $file && $fh; my $io = ($file) ? Bio::Root::IO->new(-input => $file, -flush => 1) : Bio::Root::IO->new(-flush => 1); # defaults to STDOUT
if ($type eq 'all') { my $string = $cb->($self); $io->_print($string) if $string; } else { # set up iterator
my $it = "next_$type"; $self->throw("Unknown iterator method $it") unless $self->can($it); while (my $obj = $self->$it) { my $string = $cb->($obj); $io->_print($string) if $string; } } $io->close; } } # Private methods
}
_seekabledescriptionprevnextTop
sub _seekable {
    return shift->{'_seekable'}
}

# fixes odd bad XML issue espell data (still present 6-24-07)
}
_fix_espelldescriptionprevnextTop
sub _fix_espell {
    my ($self, $response) = @_;
    my $temp;
    my $type = ref($response);
    if ($type eq 'GLOB') {
        $temp .= $_ for <$response>;
    } elsif ($type eq 'HTTP::Response') {
        $temp = $response->content;
    } else {
        $self->throw("Unrecognized ref type $type");
    }
    if ($temp =~ m{^<html>}) {
        $self->throw("NCBI espell nonrecoverable error: HTML content returned")
    }
    $temp =~ s{<ERROR>(.*?)<ERROR>}{<ERROR>$1</ERROR>};
    return $temp;
}
_load_eutil_moduledescriptionprevnextTop
sub _load_eutil_module {
    my ($self, $class) = @_;
    my $ok;
    my $module = "Bio::Tools::EUtilities::" . $class;

    eval {
        $ok = $self->_load_module($module);
    };
    if ( $@ ) {
        print STDERR <<END;
$self: data module $module cannot be found
Exception $@
For more information about the EUtilities system please see the EUtilities docs.
END
; } return $ok; } 1;
}
General documentation
TODOTop
This module is largely complete. However there are a few holes which will
eventually be filled in. TranslationSets from esearch are not currently parsed,
for instance.
FEEDBACKTop
Mailing ListsTop
User feedback is an integral part of the
evolution of this and other Bioperl modules. Send
your comments and suggestions preferably to one
of the Bioperl mailing lists. Your participation
is much appreciated.
  bioperl-l@lists.open-bio.org               - General discussion
http://www.bioperl.org/wiki/Mailing_lists - About the mailing lists
Support Top
Please direct usage questions or support issues to the mailing list:
bioperl-l@bioperl.org
rather than to the module maintainer directly. Many experienced and
reponsive experts will be able look at the problem and quickly
address it. Please include a thorough description of the problem
with code and data examples if at all possible.
Reporting BugsTop
Report bugs to the Bioperl bug tracking system to
help us keep track the bugs and their resolution.
Bug reports can be submitted via the web.
  https://redmine.open-bio.org/projects/bioperl/
AUTHOR Top
Email cjfields at bioperl dot org
APPENDIXTop
The rest of the documentation details each of the
object methods. Internal methods are usually
preceded with a _
Constructor methodsTop
Bio::Tools::EUtilities methodsTop
Bio::Tools::EUtilities::EUtilDataI methodsTop
eutilTop
 Title    : eutil
Usage : $eutil->$foo->eutil
Function : Get/Set eutil
Returns : string
Args : string (eutil)
Throws : on invalid eutil
datatypeTop
 Title    : datatype
Usage : $type = $foo->datatype;
Function : Get/Set data object type
Returns : string
Args : string
Methods useful for multiple eutilsTop
Query-related methodsTop
Summary-related methodsTop
Info-related methodsTop
Bio::Tools::EUtilities::Link-related methodsTop
Iterator- and callback-related methodsTop