Talk:Planet.osm/Archive 1
Auto update tool
I dont know how much stress there is on the server, but I can guess there is a lot. So I have thought off some sort of tool that can:
- Download latest Planet.osm
- Share this Planet.osm through Torrent
- Autodownload diff files
--Zoltan 08:30, 8 July 2008 (UTC)
- There's some stress caused by people downloading the planet, but it's not as problematic as abuses of the API and tile server (hence Acceptable Use Policy focusses on these)
- To ease off on the amount of data you're downloading, first of all think about using one of the Planet.osm#Mirrors, but also note that many of these are offering 'Extracts' of smaller areas. Only download what you need. Secondly, avoid downloading the planet again on a regular basis. Use the diffs. These are documented at Planet.osm/diffs, including the use of Osmosis tool to apply the diffs.
- Torrents could be a good idea too, but not the be all and end all. See the #Torrents discussion below
- -- Harry Wood 15:24, 24 May 2011 (BST)
Patches for broken stuff
Does the patches for broken stuff still have a use? Does it even apply to more recent versions? --Dean Earley 22:42, 5 Jun 2006 (UTC)
- I Guess not :o)
- [1] --Dean Earley 23:36, 6 Jun 2006 (UTC)
Resolved: Mateusz Konieczny (talk) 05:54, 8 March 2023 (UTC)Added more hyperlinks
I added some more Wikipedia hyperlinks to the jargon terms in the article ([2] [3]), in an attempt to make the page a little more newb-friendly. (When people "don't understand" something, usually that means they don't know what some of the words mean. Wikipedia articles usually do a pretty good job of fixing that, for software tools and such.) I also mentioned Cygwin as an easy way to get bzip2 and most other GNU tools on Windows. Feel free to edit or revert if my additions are not cool. Teratornis 16:34, 4 Jul 2006 (UTC)
- I've tried a different style of link for compression programs - using wikipedia's list (and we can edit that page if you know a program like UltimateZip that isn't on the list yet)
- I think that installing GNU on Windows is probably overkill for someone who just wants to decompress a file, especially as it doesn't have a GUI or interact with the same filesystem. Ojw 18:54, 4 Jul 2006 (UTC)
- Someone who just wants to decompress a file at the moment might eventually need other tools, e.g. sed, grep, Perl, xsltproc, built-in shell commands, etc. Maybe even a Linux GUI program like Gpsdrive (which I haven't tried on Cygwin yet, but it sounds like fun). A Linux user might use a dozen tools in the course of working with XML files and so on, without really thinking much about it, until the issue of doing all that stuff on Windows comes up (as it tends to, given the vast number of Windows computers out there). I suppose the real question is how many references to GNU tools might come up; here's another one: Talk:JOSM#Cannot_Read_Time_From_Point_x shows a sed command line and asks how to do it in Windows. A Windows user who follows along with the work of Linux users could spend a lot of time downloading tools individually, and then the resulting hodge-podge won't be easily maintainable. Cygwin is simple to install (and uninstall), has built-in package management, and provides a large set of GNU tools. Perhaps it would be good to inventory all the references to GNU tools here, for example search for xsltproc (such references may expand in the future as people think of new ways to manipulate OSM data), and create a separate page for Windows users, telling them their options if they want to keep pace with the Linux command-line examples. I get the impression that the technical leaders here are mostly using Linux or Mac OS X, and their hacks might be difficult for the stock Windows user (but straightforward for the Cygwin user, who can often use the same shell syntax). I agree it is inefficient to explain all this in every article that mentions a GNU tool, but I think it's worth explaining once. Teratornis 07:19, 5 Jul 2006 (UTC)
- I started a User page (User:Teratornis/WindowsUsers) where I will try to inventory the GNU tool command-line examples throughout the OSM Wiki and Talk pages (or at least a large enough subset of them to show the scale of the problem for a Windows user; so far I see bash, bzip2, gnuplot, sed, svn, xsltproc), and list some options for the Windows user along with their pros and cons. Anyone with an interest may then review my user page, and we can decide if and where to publish it, and then go around linking articles to it. Teratornis 17:24, 5 Jul 2006 (UTC)
OSM Coverage Map for USA?
The map of OSM coverage in Europe looks great. I would like to see a similar map for North America, or at least for the USA. Among other things, that would tell us how the TIGER import is proceeding. If someone with knowledge can make such a map, that would be wonderful. Otherwise, I might try to figure out how to do it. Teratornis 16:34, 4 Jul 2006 (UTC)
- The easier way to do this would be a REST API function count?bbox=bllon,bllat,trlon,trlat that returns the number of nodes and segments in an area -- you could write all sorts of statistical programs to use that (density charts etc.) without having to download any data or parse any segments. Ojw 19:03, 4 Jul 2006 (UTC)
- I'll check this out when I get a chance. Thanks. Teratornis 19:54, 6 Jul 2006 (UTC)
Resolved: Mateusz Konieczny (talk) 05:54, 8 March 2023 (UTC)Latest one
<tag k='name' v='St Andrew's Church of England Primary School' />
Where does the single-quote end? Ojw 15:50, 8 Aug 2006 (BST)
It's possible to extract region from Planet.osm?
I am living in Slovakia. It's is possible to extract region or country as .osm from planet.osm. Because planet.osm is very big to open to process in everything..
- You can use the excerpt-area perl script for that. It exctracts a rectangular area. For a more complex approach that extracts a polygon, see http://trac.openstreetmap.org/browser/utils/planet.osm/perl/extract-germany.pl which you would have to modify to use Slovakia's border polygon. --Frederik Ramm 12:34, 9 March 2007 (UTC)
- Polygon for Slovakia is at http://svn.moonbase.sk/slovakia.osm/polygon_slovakia.txt
Compressed planet dump growing every week by 150 MB. Now it's about 1GB. Is it possible to generate planet.osm divided into smaller areas i.e. europe.osm, asia.osm, america.osm... right on osm servers...? --Dido 08:53, 4 October 2007 (BST)
- (Old discussion) 1GB? how quaint. Today it's 16GB. These days we've also got some better options. You can download extracts. Various options listed: Planet.osm#Mirrors, or run your own extract using a tool such as Osmosis (There are other tools listed at Planet.osm#Processing the File which can do extracts) -- Harry Wood 15:35, 24 May 2011 (BST)
Resolved: Mateusz Konieczny (talk) 05:54, 8 March 2023 (UTC)Malformed XML still?
In this article you can read:
"The file is in the OSM XML format. However, until the 0.4 API is rolled out, the planet.osm dump typically contains UTF-8 errors that will break an XML parser. "
Since we now use API version 0.5, this is supposedly fixed. Cany anyone confirm that?
- (old discussion) Pretty sure the generated planet files don't have any UTF problems these days (on API 0.6 now) -- Harry Wood 15:37, 24 May 2011 (BST)
Resolved: Mateusz Konieczny (talk) 05:55, 8 March 2023 (UTC)