Talk:JTileDownloader

From OpenStreetMap Wiki
Jump to navigation Jump to search

General Discussion

  • I'm not sure the best way to submit patches, hopefully this is ok. There are two, both here: http://icculus.org/~chunky/stuff/jtileDownloader/ User:chunkyks
    • mapquest_data.diff is a patch to use mapquest OSM rendered, and satellite tiles. MQ Usage policy: http://developer.mapquest.com/web/products/open/map
    • OSMTileProvider is for downloading from OSM. Usage policy: http://wiki.openstreetmap.org/wiki/Tile_usage_policy
    • Obviously this one requires an addition "new OSMTileProvider()" added to the list in TileProviderList
      • I'll add MapQuest source in next version, but what's the difference between OSMTileProvider and [1]? Also, such minor things as adding new layers could be done with a simple URL of tiles. --Zverik (talk) 20:29, 13 September 2013 (UTC)
        • Oh, man... mapnik is exactly what I want. Don't know why I didn't notice that :-/ . Just forget about the OSMProvider!
    • I've just added another patch [tilelist_append.diff] there, that adds an extra button to the gui next to "export", called "append" User:chunkyks
    • http://icculus.org/~chunky/stuff/jtileDownloader/
    • I keep wanting to download non-square patches of data. Long-term, I'd like to be able to draw an outline to the slippy map rather than a box, but append allows me to choose multiple boxes without having to mess with the filesystem
      • If you plan on using JTD in long term, you are doing it wrong. Please install PostGIS/Mapnik, setting up your own rendering toolchain. As a bonus, you'll be able to produce tiles for any shape with polytiles.py. --Zverik (talk) 15:16, 18 September 2013 (UTC)
        • I'm in the process of setting that up. But JTD is still the tool I'm going to help other people use to batch download tiles from my server [typical usage is to download so they can drag to an airgapped network or standalone device]

Feature Requests

  • (R19) Similar to R18, do not limit openstreetmap.org to z18, as it now has z19 as well
  • (R18) Do not limit to z18. We now have z19^W^W20 @openstreetmap.fr :-) thank's --Marc (talk) 17:20, 22 March 2013 (UTC)
  • (R17) and follow-up to R16, since the data for rendering a metatile is cached for a small time, if several zoom levels are requested, JTD should download 4 metatiles for zoom N+1 right after it downloaded a metatile for zoom N. There could be two options: download zooms separately or all the way down.
  • (R16) mod_tile renders tiles in packs called "metatiles". They are 8x8 tiles. To lessen server load, JTD should download data not in rows, but in 8x8 packs.
  • (R15) imho, it'll be much clearer & intuitive if the lat/lon bounds text fields would be placed like in a cross (like at http://www.openstreetmap.org/export/)
  • (R14) Update tiles should not redownload all files. Better only update tiles which are older than a specific date OR better: use last-modified-http-header --MrTux 19:24, 13 May 2009 (UTC)
    • some time ago, I already tried to use the last-modified-http-header but I didn't got any information from this (got only an empty string). I think I will try it again - maybe there is now some information about the last modified time. --fma 15:59, 14 May 2009 (UTC)
  • (R13) Could "Overwrite existing files" be split into "always" and "if changed"? The file size could be used to determine if the tile had changed. This could save wear on flash media for tiles that don't change often. --goldfndr 02:53, 15 April 2009 (UTC)
    • Would be a good idea. I will implement this for the next version --fma 08:01, 21 April 2009 (UTC)
    • There is a HTTP-Request called HEAD, which returns the Content-Length (Size) and Last-Modified. This could be useful. --Brunni 19:43, 30 May 2009 (UTC)
      • nope. The sender/script has to send it. -> OSM-mapnik doesn't. --MrTux 15:02, 19 August 2009 (UTC)
  • (R12) Download Tiles along a GPX-File with a corridor of "x km" on each side. This would help to reduce the number of Tiles in a greater area --TimG 21:24, 17 November 2008
  • (R11) Generate calibration files like taho.pl does, so that the tiles can be used with programs like Glopus, Oziexplorer etc. --Lesi 14:46, 17 November 2008 (UTC)
    • Me too :-) I also would like to see *.pgw-files (world-files). OSMTileDownloader creates them, but I think these are not correct.--Konus 16:11, 30 November 2008 (UTC)
    • Mee too wish *map calibration file France-59-valenciennes 06:50, 2 May 2009 (UTC)
  • (R10) (included in v0-4-0) Actually I have no idea what "Radius" means exactly in terms of tile numbers. I would prefer to select a range of tile numbers (e.g. 2482-2487, 4310-4313, 12) or the coordinates of a rectangular region to define the area I want to download. With "radius" I probably download too many tiles now. --Raschu 16:30, 2 November 2008 (UTC)
    • I planned to add different download possibilities and I will also add an option to specify a range of tile numbers --fma 22:03, 3 November 2008 (UTC)
  • (R9) (included in v0-4-0) Option to over-ride the level selection to download/export all levels not just one *I currently open multiple JTileDownloaders to save waiting for it to finish each time*--Solexious 19:02, 29 October 2008 (UTC)
    • I will include a text field to enter a comma seperated string (eg. 13,14,15,16) to download all specified zoom levels. Via the update tiles function it's already possible to multi-select in the table all levels to update --fma 09:16, 30 October 2008 (UTC)
      • Thank you, thats great. --Solexious 12:04, 30 October 2008 (UTC)
  • (R8) (included in v0-4-0) a button to stop an action (esp. download) In case you seleceted a wrong area. Hadhuey 09:51, 25 October 2008 (UTC)
    • I already thought about this and will include something in the next version. As workaround it's possible to just close the program via the 'X' to stop the download/update. --fma 07:22, 27 October 2008 (UTC)
  • (R7) (included in v0-1-0) Include cyclemap URL (http://c.andy.sandbox.cloudmade.com/tiles/cycle) --fma 10:33, 22 September 2008 (UTC)
  • (R6) (included in v0-3-0)Check selected folder in which tiles exists and only download these (like updating a tile set) --MrTux 14:36, 18 September 2008 (UTC)
    • planned for next version (> v0-2-0) --fma 14:59, 21 October 2008 (UTC)
    • done --fma 22:59, 23 October 2008 (UTC)
  • (R5)(included in preTest2) An user definded target to save the tiles (and make it easy to find them on the drive) Hadhuey 20:05, 19 August 2008 (UTC)
    • in version JTileDownloader-preTest2 there is an input field 'Outputfolder' where you can specify (absolute and relative) the outputfolder of the tiles.
    • Maybe you can give a hint that you have to type in your preferred destination or make a screenshot with an example (e.g. "c:\tiles). Hadhuey 21:13, 20 August 2008 (UTC)
    • I will include a screenshot with an example --fma 18:31, 21 August 2008 (UTC)
    • Thanks, cool program. Hadhuey 20:08, 25 August 2008 (UTC)
  • (R4) Use it as comfortable gpsfetchmap replacement and export maps to GPSDrive and update the map_koord.txt file automatically.
    • maybe in some later version. I will think about it. --fma 21:21, 21 August 2008 (UTC)
  • (R3)(included in v0-0-1) Option to download zoom level 18 tiles --Solexious 21:37, 3 August 2008 (UTC)
    • included in next version
  • (R2)(included in v0-0-1) An option to only download a certain amount of tiles, then pause for an amount of time to prevent overloading a server with requests --Solexious 01:32, 2 August 2008 (UTC)
    • should also be no problem, included one of the next versions
  • (R1)(included in v0-0-1) The option to choose to export the list of tile locations into a txt file rather than downloading them --Solexious 01:32, 2 August 2008 (UTC)
    • no problem, included in next version

Bugs

  • (B13-Solution) - This is actually no bug but a feature...sort of. The jTileDownloader v0.6.0 requires Java SE 7 (aka Java v1.7.x). Fixing this so also older Java Runtimes are supported is quite simple as only two methods are effected. The build I created (source is available too) should be working on Java SE 5 and Java SE 6: http://help.openstreetmap.org/questions/11508/tiles-arent-being-generated/11596
  • (B13a) Got the same error:
java -version
java version "1.6.0_20"
OpenJDK Runtime Environment (IcedTea6 1.9.10) (6b20-1.9.10-0ubuntu1~10.04.3)
OpenJDK 64-Bit Server VM (build 19.0-b09, mixed mode)
me@me-desktop:~$ java -jar /home/me/jTileDownloader/jTileDownloader-0-6-0.jar 
Exception in thread "AWT-EventQueue-0" java.lang.NoSuchMethodError: java.lang.Integer.compare(II)I
	at org.openstreetmap.fma.jtiledownloader.datatypes.TileComparatorFactory$QuadComparator.compare(TileComparatorFactory.java:57)
	at org.openstreetmap.fma.jtiledownloader.datatypes.TileComparatorFactory$QuadComparator.compare(TileComparatorFactory.java:55)
[...]
  • (B13b) I was attempting to download a tileset and got the error below:
Exception in thread "AWT-EventQueue-0" java.lang.NoSuchMethodError: java.lang.Integer.compare(II)I
	at org.openstreetmap.fma.jtiledownloader.datatypes.TileComparatorFactory$QuadComparator.compare(TileComparatorFactory.java:57)
	at org.openstreetmap.fma.jtiledownloader.datatypes.TileComparatorFactory$QuadComparator.compare(TileComparatorFactory.java:55)
[...]
  • (B12) OpenCycleMap Tileserver URL Needs to be updated, some tiles can't be loaded. Please refer to this page: http://www.gravitystorm.co.uk/shine/change-of-tileserver-url/
  • (B11) Does not work with a bounding box with negative longitudes. For instance when you try the US (min lat 25, max lat 52, min long -124, max long -64) - it only downloads the Eastern part of the US (the farthest west is Illinois). This has the same cause as Bug 9. The MIN_LON and MAX_LONG values are WRONG. Version 0.5. akreider 19 August 2011
  • (B10) Copying and pasting an OSM permalink into the 'paste url' doesn't update the latitude and longitude boxes. One needs to change tabs and then come back to Paste Url to update the boxes. --Nickelliott 19 June 2010
  • (B9) Buggy behaviour when longitude > 90, for e.g. try to download something in Indonesia.
   -- B9 is due to invalid Lat Lon clamping. To fix, Swap MIN_LAT,MIN_LON and MAX_LAT,MAX_LON in Constants.java. Had the same problem with San Francisco.
  • (B8) Only empty (white) tiles are downloaded when using this link (dev version)
    • Bug can be reproduced. I will try to find the problem this week --fma 07:18, 1 February 2010 (UTC)
      • Could you find the bug? --Blubbi 16:31, 6 February 2010 (UTC)
        • seems like commenting out the min max cap in the methods calculateTileX/Y in TileListCommon.java will fix the problem. Any hint on why one needs those caps? --Blubbi 04:38, 28 February 2010 (UTC)
  • (B7) No download on zoom level 15 or higher. On version 0.4.0(latest) i downloaded the tiles up to zoom level 14 using the bounding box(lat/lon)-tab. but the same settings for zoom level 15 and higher won't do. It does something awhile(full cpu usage) then nothing - it stays with the download button on "stop download". do you have any idea?
    • Can you give me the coordinates of the bounding box you tried to download for zoom lvl 15? --fma 09:37, 27 July 2009 (UTC)
  • (B6) With Version 0-4-0, "Update Tiles" is not working. The table displayed is to small to select a zoom level.
    • Version 0-4-0: The problem with the condensed table in the 'update tab' is triggered by lengtht/contents of the 'output folder' value in the 'main tab'. It makes no difference if 'output folder' exists or not.
      • Examples of values that are ok:
        • C:\Dokumente und Einstellungen\Bernd\Eigene Dateien\JTileDownloader\tiles123
        • TilesRheinMain
      • Examples of values that are not ok:
        • C:\Dokumente und Einstellungen\Bernd\Eigene Dateien\JTileDownloader\tiles1234
        • C:\Dokumente und Einstellungen\Bernd\Eigene Dateien\JTileDownloader\tiles_rheinmain
      • If the table is visible the update works fine. Workarond: use relative(short) pathes. Absolute pathes appear if you use the GUI to select 'output folder'. --Bl13916 19:58, 30 June 2009 (UTC)
    • I can confirm that "Update Tiles" does not work. --MrTux 19:24, 13 May 2009 (UTC)
    • Could you please post the java version & screen resolution you are using?--fma 08:03, 21 April 2009 (UTC)
    • I resolved that the Problem did not occur with Version 0-3-0 because you could resize the window of JTileDownloader. With 0-4-0 the resizing of the window is disabled. I discovered this Problem with a screen-resolution of 1280x1024 and java version 1.6.0_04
  • (B5) (fixed v0-1-0) Download doesn't work. No tiles are downloaded. Example URL http://www.openstreetmap.org/?lat=37.3466&lon=-121.8484&zoom=12&layers=0B00FTF tested other URL in and they worked fine.
    • found the problem, would be fixed in next version. --fma 07:33, 6 October 2008 (UTC)
  • (B4) (closed) Past URL doesn't work for me. I tried all downloadable versions. Handling error? Frank1937
    • Can you please paste the URL you tried here? --fma 18:41, 2 October 2008 (UTC)
    • As I did not got more information on this bug, I've closed this issue (Maybe it was the same problem as B5) --fma 21:35, 9 October 2008 (UTC)
  • (B3) proxy authorization doesn't work for me. But with export list and wget it was easy. --Wieland 08:44, 6 September 2008 (UTC)
    • I will try to get proxy authorization working with Java 1.5 --fma 07:16, 15 September 2008 (UTC)
    • Please try following and report if it works java -Dhttp.proxyHost=<proxyserver> -Dhttp.proxyPort=<proxyport> -jar JTileDownloader_x-x-x.jar --fma 12:03, 16 September 2008 (UTC)
    • With 0-4-0 proxy specification (even w/o authorization) still isn't forwarded to java correctly--"-Dhttp.proxyHost=<proxyserver> -Dhttp.proxyPort=<proxyport>" works fine! (I am using Java Portable 6 Update 14.) --Barefoot 08:38, 30 June 2009 (UTC)
  • (B2)(fixed v0-0-1) In case of an error, don't abort the download, but resume with the next tile.

Example if you try to download a tile near the coast:

java.io.FileNotFoundException: http://tah.openstreetmap.org/Tiles/tile/6/19/25.png
at sun.net.www.protocol.http.HttpURLConnection.getputStream(HttpURLConnection.java:1239)
at org.openstreetmap.fma.jtiledownloader.JTileDownloader$1.run(JTileDownloader.java:149)
at java.lang.Thread.run(Thread.java:619) --Psikodad 14:21, 3 August 2008 (UTC)
  • (B1)(fixed v0-0-1) Some times the tile server returns a 500 error and that causes the download q to stop. Would it be possible to stop the q for say 10 seconds then try to resume? --Solexious 01:27, 2 August 2008 (UTC)
    • 500 error should now be handled. If 500 error occurs the download q waits for 10 sec and retries the download 5 times. After 5 failed retries it will continue with the next tile --fma 21:19, 21 August 2008 (UTC)
    • Would it be possible to have a button appear at the end of a download Q to try all failed tiles? Due to me getting my tiles from the "cloud" some times it is a min or two before a tile is available again.--Solexious 13:25, 31 August 2008 (UTC)
    • Good idea, I will include something in one of the next versions --fma 07:16, 15 September 2008 (UTC)
    • (included in v0-1-0) --fma 21:35, 9 October 2008 (UTC)
  • I have a map source that uses .jpg tiles, the system only wants to download .png tiles. Can this be changed or configured??--Shane.williams 19:08, 4 May 2010 (UTC)