Search Members Help

» Welcome Guest
[ Log In :: Register ]

Pages: (2) < 1 [2] >

[ Track this topic :: Email this topic :: Print this topic ]

reply to topic new topic new poll
Topic: XML cache data, Cache data and logs via XML< Next Oldest | Next Newest >
GeoRockers Offline
Caching Maniac




Group: Members
Posts: 167
Joined: Feb. 2002
Posted: Feb. 12 2004,6:27 pm QUOTE

Greetings Scout,

Quote (Scout @ Feb. 12 2004,7:39 am)
Welcome back, GeoRockers, and thanks for the enhancements.


You're welcome. :)


Quote (Scout @ Feb. 12 2004,7:39 am)
I'll be playing with them over the next few days for the stats pages I maintain. It'll be a slow process because I only run the script four times a week.


I fixed the bug with NewOrModifiedSince not displaying updated logs.

NewOrModifiedSince accepts a datetime argument (which now works), so a full cache/log dump is no longer required after the first call.


Code Sample

# psuedo code example
# first call to script - store the time of call in YYYY-MM-DD HH:MM:SS format
https://www.navicache.com/cgi-bin/db/XMLSearchResults.pl?AllCacheData=1&LogStats=1&gzip=1

# the next call to script, use the previously stored time as an argument to the script
https://www.navicache.com/cgi-bin/db/XMLSearchResults.pl?NewOrModifiedSince=YYYY-MM-DD HH:MM:SS&AllCacheData=1&LogStats=1&gzip=1


The fixed NewOrModifiedSince argument, along with the gzip=1 argument, gives you the ability to call the script once an hour. :D

BTW - I know you know how to code.  The psuedo code example is for others reading this thread. :)

Quote (Scout @ Feb. 12 2004,7:39 am)
Last night's run failed, so I'll try to debug it. During this process, the stats page will be screwed up.


Sorry about that. :(

Quote (Scout @ Feb. 12 2004,9:35 am)
I asked for an option to suppress getting the text of log entries, because that's the biggest part of the data and I ignore that anyway for stats generation. You provided an argument "LogStatsOnly=1". Although this suppresses the log descriptions, as expected and wanted, it also suppresses the cache information. What I would like is an option "LogStats=1" that works exactly like "logs=1" but suppresses the log_entry field of log entries.


It's done. :D


George


Edited by GeoRockers on Feb. 12 2004,7:09 pm

--------------
A 1/1 via the trail around the hill?
Nah... that's too easy!  Let's go up and over!
Why follow a trail when we can blaze our own? :p

We *make* mountains out of mole hills!
Back to top
Profile PM 
rickrich Offline
Navicacher




Group: Members
Posts: 4
Joined: Mar. 2004
    Posted: April 04 2004,1:46 pm QUOTE

What is the URL parameter to get GPX data?
Back to top
Profile PM WEB 
PC Medic Offline
Cache Master




Group: Super Administrators
Posts: 1452
Joined: Dec. 2001
    Posted: April 04 2004,2:03 pm QUOTE

While GPX formatted data is in the plans we currently only provide XML. There are utilities available to make the conversion for you.

--------------
'PC Medic'
Back to top
Profile PM AOL YIM 
larsl Offline
Navicacher




Group: Members
Posts: 8
Joined: Dec. 2004
    Posted: June 03 2005,9:52 am QUOTE

Would it be possible to add the user ID to the log entries in the XML files? This would make it possible to use the logs in the XML file to create a link to the member details page for the member that wrote the log.
Back to top
Profile PM 
PC Medic Offline
Cache Master




Group: Super Administrators
Posts: 1452
Joined: Dec. 2001
    Posted: June 04 2005,6:27 pm QUOTE

Quote (larsl @ June 03 2005,11:52 am)
Would it be possible to add the user ID to the log entries in the XML files? This would make it possible to use the logs in the XML file to create a link to the member details page for the member that wrote the log.

The ID of the member submitting the log entry is now included with the XML log data.

Please also see the PM I sent you


--------------
'PC Medic'
Back to top
Profile PM AOL YIM 
PC Medic Offline
Cache Master




Group: Super Administrators
Posts: 1452
Joined: Dec. 2001
    Posted: Mar. 18 2006,11:09 pm QUOTE

The 'gzip' argument has been removed from the XML search function.

--------------
'PC Medic'
Back to top
Profile PM AOL YIM 
GeoRockers Offline
Caching Maniac




Group: Members
Posts: 167
Joined: Feb. 2002
    Posted: April 15 2006,12:38 am QUOTE

Greetings Everyone!

Quote (PC Medic @ Mar. 18 2006,10:09 pm)
The 'gzip' argument has been removed from the XML search function.

This was done at the request of the hosting company.

Another change is that XMLSearchResults.pl should not be called more than once in a 5 minute period.

Why, do you ask?

Someone wrote a multi-threaded bot and unleashed it without testing it off-line... :nono

The bot sent a lot of requests in a very short time period...

Let's just say that our hosting company wasn't too happy about the stress testing... :p

The irony is... the bot author was after the cache data... which is available via the XMLSearchResults.pl script... ::sigh::

Thanks for your patience and understanding.


GeoRockers


--------------
A 1/1 via the trail around the hill?
Nah... that's too easy!  Let's go up and over!
Why follow a trail when we can blaze our own? :p

We *make* mountains out of mole hills!
Back to top
Profile PM 
ChileHead Offline
Navicacher




Group: Members
Posts: 29
Joined: Aug. 2004
    Posted: April 26 2006,6:59 pm QUOTE

I've noticed that new caches return "0.0000000" in the latitude and longitude in the XML data.  After a little while (not sure how long) the right values are there, but at least the first request I make for XML data shortly after a new cache is published has zeros.
Back to top
Profile PM 
GeoRockers Offline
Caching Maniac




Group: Members
Posts: 167
Joined: Feb. 2002
Posted: April 27 2006,6:54 am QUOTE

Hello ChileHead,

Quote (ChileHead @ April 26 2006,5:59 pm)
I've noticed that new caches return "0.0000000" in the latitude and longitude in the XML data.  After a little while (not sure how long) the right values are there, but at least the first request I make for XML data shortly after a new cache is published has zeros.


Thanks for bringing this to our attention (now fixed). :)

The effect was triggered by the quick approval of a cache (within an hour of submission). :grinnin:



GeoRockers


Edited by GeoRockers on April 27 2006,6:55 am

--------------
A 1/1 via the trail around the hill?
Nah... that's too easy!  Let's go up and over!
Why follow a trail when we can blaze our own? :p

We *make* mountains out of mole hills!
Back to top
Profile PM 
PC Medic Offline
Cache Master




Group: Super Administrators
Posts: 1452
Joined: Dec. 2001
    Posted: Aug. 09 2006,4:03 pm QUOTE

The XML Cache Data retrieval function is temporarily not available while some system updates are being made.

We apologize for any inconvenience.


--------------
'PC Medic'
Back to top
Profile PM AOL YIM 
Banana Joe Offline
Navicacher




Group: Members
Posts: 3
Joined: April 2004
    Posted: Nov. 05 2006,5:44 am QUOTE

Quote (PC Medic @ April 04 2004,4:03 pm)
While GPX formatted data is in the plans we currently only provide XML. There are utilities available to make the conversion for you.

Could you please specify/name the utilities that can do the conversation XML-->GPX. Thank you very much.
Back to top
Profile PM 
PC Medic Offline
Cache Master




Group: Super Administrators
Posts: 1452
Joined: Dec. 2001
    Posted: Nov. 06 2006,7:25 am QUOTE

Quote (Banana Joe @ Nov. 05 2006,7:44 am)
Quote (PC Medic @ April 04 2004,4:03 pm)
While GPX formatted data is in the plans we currently only provide XML. There are utilities available to make the conversion for you.

Could you please specify/name the utilities that can do the conversation XML-->GPX. Thank you very much.

Try the GPS Visualizer converter .

Also, we now offer the option to download directly in GPX format


--------------
'PC Medic'
Back to top
Profile PM AOL YIM 
Banana Joe Offline
Navicacher




Group: Members
Posts: 3
Joined: April 2004
    Posted: Nov. 06 2006,10:12 am QUOTE

Quote (PC Medic @ Nov. 06 2006,9:25 am)
Quote (Banana Joe @ Nov. 05 2006,7:44 am)
Quote (PC Medic @ April 04 2004,4:03 pm)
While GPX formatted data is in the plans we currently only provide XML. There are utilities available to make the conversion for you.

Could you please specify/name the utilities that can do the conversation XML-->GPX. Thank you very much.

Try the GPS Visualizer converter .

Also, we now offer the option to download directly in GPX format

Thank you for this quick answer.

The XML file I got from the first poste http://www.navicache.com/cgi-bin/db/XMLSearchResults.pl (with all 6997 Navicaches) is around 5 MB big. The GPS Visualizer can only handle up to 3 MB. I'm now using the original: GPSbabel One can easily import the Navicache-XLM-format and export e.g. to GPX XML. This data can then be loaded into GSAK.

The direct download in GPX format from your website is only possible for one page --> 25 caches. Is that right? That is not very comfortable.

I would like to use the a.m. XML-download for all (new) caches in Germany. First I need to modify the a.m. script. But how do I get it run? I'm missing something... Can you help me?


Edited by Banana Joe on Nov. 06 2006,10:14 am
Back to top
Profile PM 
vonRichthofen Offline
Navicacher




Group: Members
Posts: 2
Joined: Mar. 2007
    Posted: Sep. 06 2007,4:09 pm QUOTE

Is this thing still working? As the GPX-files do not contain cache type and no programm can correctly handle your loc files (didnt find one) i tried to receive all german caches by xml. But all i got was some text with the terms of use. I also tried the sample codes - with the same result. Am i doing something wrong?
Back to top
Profile PM WEB 
Scout Offline
Cache Master




Group: Members
Posts: 721
Joined: June 2001
    Posted: Sep. 06 2007,4:56 pm QUOTE

Yes, it's still working. Here's an example:

http://www.navicache.com/cgi-bin....&logs=1


--------------
Scout  ( http://GPSgames.org )
Back to top
Profile PM 
vonRichthofen Offline
Navicacher




Group: Members
Posts: 2
Joined: Mar. 2007
    Posted: Sep. 06 2007,5:13 pm QUOTE

Strange... now it worked. Maybe i got throttled.

Thanks for the quick answer.


Edited by vonRichthofen on Sep. 06 2007,5:16 pm
Back to top
Profile PM WEB 
Alan White Offline
Navicacher




Group: Members
Posts: 5
Joined: Jan. 2009
    Posted: Jan. 22 2009,8:33 am QUOTE

As a newcomer here though a long standing member of Groundspeak I'm keen to get Navicache data into GSAK as I do with Groundspeak. I tried the GPX files but there's little data in there and I see on another thread that that's an outstanding issue.

So I tried XML as suggested here. I believe that the command I want to get all UK caches with full descriptions, hints and logs is http://www.navicache.com/cgi-bin....&logs=1 but this returns no data. What am I doing wrong?
Back to top
Profile PM 
PC Medic Offline
Cache Master




Group: Super Administrators
Posts: 1452
Joined: Dec. 2001
    Posted: Jan. 26 2009,3:43 pm QUOTE

Quote (Alan White @ Jan. 22 2009,10:33 am)
As a newcomer here though a long standing member of Groundspeak I'm keen to get Navicache data into GSAK as I do with Groundspeak. I tried the GPX files but there's little data in there and I see on another thread that that's an outstanding issue.

So I tried XML as suggested here. I believe that the command I want to get all UK caches with full descriptions, hints and logs is http://www.navicache.com/cgi-bin....&logs=1 but this returns no data. What am I doing wrong?

should be country=UK

--------------
'PC Medic'
Back to top
Profile PM AOL YIM 
Alan White Offline
Navicacher




Group: Members
Posts: 5
Joined: Jan. 2009
    Posted: Jan. 28 2009,2:26 am QUOTE

Quote (PC Medic @ Jan. 26 2009,10:43 pm)
should be country=UK

Great. Many thanks. Now to work out how to get GPSBabel to convert it to GPX...
Back to top
Profile PM 
Alan White Offline
Navicacher




Group: Members
Posts: 5
Joined: Jan. 2009
    Posted: Jan. 28 2009,4:53 am QUOTE

Hmm.. getting GPSBabel to convert Navicache XML to GPX is easy but doesn't seem to get me any further ahead as GPSBabel doesn't convert all the fields so the result is only a little better than Navicache's own GPX.

Surely I'm not alone in wanting to load Navicache data into GSAK with full details? Has anyone else done this and can describe their method?

Oh, and even in the XML many caches (65 of the UK's 187) have 0 as the coords.
Back to top
Profile PM 
jesperv Offline
Navicacher




Group: Members
Posts: 2
Joined: Feb. 2009
    Posted: Feb. 16 2009,9:13 am QUOTE

Is it possible to add coordinates and a range to the search criteries like on the normal site. I want to use the functionality for a mobile phone application that can show geocaches in near proximity of the users current position.

//Jesper
Back to top
Profile PM 
whiteurkel Offline
Caching Maniac




Group: Members
Posts: 83
Joined: Jan. 2004
    Posted: Feb. 17 2009,11:03 am QUOTE

Quote (Alan White @ Jan. 28 2009,6:53 am)
Hmm.. getting GPSBabel to convert Navicache XML to GPX is easy but doesn't seem to get me any further ahead as GPSBabel doesn't convert all the fields so the result is only a little better than Navicache's own GPX.

Surely I'm not alone in wanting to load Navicache data into GSAK with full details? Has anyone else done this and can describe their method?

Oh, and even in the XML many caches (65 of the UK's 187) have 0 as the coords.

I was helping someone last year, and I don't believe we were ever successful in getting Navicache data with full details into GSAK via the XML interface and GPS Babel.

Are the GPX downloads still having problems?

To be honest, with an influx of disgruntled members from the Frog website from recent incidents involving The U.S. Military and The UK, I really think both these issues should be vigorously addressed.  :D


--------------
Back to top
Profile PM 
PC Medic Offline
Cache Master




Group: Super Administrators
Posts: 1452
Joined: Dec. 2001
    Posted: Feb. 17 2009,1:26 pm QUOTE

Quote (jesperv @ Feb. 16 2009,11:13 am)
Is it possible to add coordinates and a range to the search criteries like on the normal site. I want to use the functionality for a mobile phone application that can show geocaches in near proximity of the users current position.

//Jesper

I will look into implementing this, but patience will be needed.

--------------
'PC Medic'
Back to top
Profile PM AOL YIM 
PC Medic Offline
Cache Master




Group: Super Administrators
Posts: 1452
Joined: Dec. 2001
    Posted: Feb. 17 2009,1:39 pm QUOTE

Quote (whiteurkel @ Feb. 17 2009,1:03 pm)
I was helping someone last year, and I don't believe we were ever successful in getting Navicache data with full details into GSAK via the XML interface and GPS Babel.

The data is in the Navicache XML file. If getting it into GSAK is the issue, then perhaps asking on their end would be a better place to start. I can provide the data in XML format (which we do), but if another application was written with another sites interests in mind... well that would be out of my hands.

Quote

Are the GPX downloads still having problems?


If you are referring to some caches showing NULL coordinates, the answer would be yes if that cache owner has not updated the listing having the issue. There is another post that addresses the GPX download issue and what can be done to help correct it.

Quote

To be honest, with an influx of disgruntled members from the Frog website from recent incidents involving The U.S. Military and The UK, I really think both these issues should be vigorously addressed.  :D


I will address them as best I can even without any such influx. Just needs to be brought to my attention and within my power to correct. Third party application issues I will work with the author in any way I can to help, but they need to be the first point of contact. Other items I will correct as quickly as I can.


--------------
'PC Medic'
Back to top
Profile PM AOL YIM 
jesperv Offline
Navicacher




Group: Members
Posts: 2
Joined: Feb. 2009
    Posted: Feb. 21 2009,7:16 am QUOTE

Quote (PC Medic @ Feb. 17 2009,3:26 pm)
Quote (jesperv @ Feb. 16 2009,11:13 am)
Is it possible to add coordinates and a range to the search criteries like on the normal site. I want to use the functionality for a mobile phone application that can show geocaches in near proximity of the users current position.

//Jesper

I will look into implementing this, but patience will be needed.

Sounds great. Right now i am using geocaching.com but will rather add navicache.com as a posibillity in the application.
Back to top
Profile PM 
rickrich Offline
Navicacher




Group: Members
Posts: 4
Joined: Mar. 2004
    Posted: Mar. 05 2012,5:55 am QUOTE

http://www.navicache.com/cgi-bin/db/XMLSearchResults.pl?state=MN&NewOrModifiedSince=2002-03-05

Doesn't work since 03/05/2012:

"The File or page located at /cgi-bin/db/XMLSearchResults.pl?state=MN&NewOrModifiedSince=2002-03-05 Was not found on www.navicache.com Sorry, the file you were looking for could not be found. It may have moved to a new location. Please use the navigation to the left to help you locate the file. You can also search for a file by using the Search Page at this site. click the link below: to return to the referring page Click Here "
Back to top
Profile PM WEB 
PC Medic Offline
Cache Master




Group: Super Administrators
Posts: 1452
Joined: Dec. 2001
    Posted: Mar. 06 2012,1:59 pm QUOTE

temporarily disabled

--------------
'PC Medic'
Back to top
Profile PM AOL YIM 
56 replies since Aug. 26 2002,4:48 am < Next Oldest | Next Newest >

[ Track this topic :: Email this topic :: Print this topic ]

Pages: (2) < 1 [2] >
reply to topic new topic new poll

Quick Reply: XML cache data
iB Code Buttons
You are Posting as:
Guest
Do you wish to enable your signature for this post?
Do you wish to enable emoticons for this post?
Track this topic
View All Emoticons
View iB Code