Recently one of my little side pursuits has been playing with OpenStreetMap. I had tinkered with it a little bit some time ago, and decided to revisit it.


Recently one of my little side pursuits has been playing with OpenStreetMap. I had tinkered with it a little bit some time ago, and decided to revisit it.
I recently inherited some older machines and, to support some ongoing in-house experimentation I've been involved in, set them up as quick-and-dirty servers to help serve up geospatial data services - the approach I took was to build what are essentially minimal machines running linux in command-line mode, and then load GeoServer on them to serve the data - As I haven't blogged in a while, a friend suggested that posting a quick description of the mechanics of this might be a good thing to share for folks who haven't dipped their toes into Linux much.
As a disclaimer, I do not claim to profess guruhood when it comes to Linux or the other packages, this is not necessarily warranted to be a "hardened-and-tweaked" system for production, it's just some very quick and dirty steps toward standing up a headless Linux-based GeoServer instance. Note that this uses the default Jetty install - some folks prefer to run it under Tomcat, which is a different path.
So, I started out with the "minimal install CD" for Ubuntu 9.04, available here:
https://help.ubuntu.com/community/Installation/MinimalCD
Select a package appropriate for the CPU you are using - in my case, I chose Ubuntu 9.04 for 32-bit PC.
Burn the ISO and follow the prompts to install from the text-based installer as command-line interface (CLI). I essentially went with the defaults. You will want to have the machine connected to the internet so that it can identify and set up the network connection and grab any files needed during install.
Once you've installed a minimal version of Linux, you will be ready to configure and install the other goodies.
sudo apt-get install openssh-server
sudo
tells it to use superuser privileges and permissions, and will ask for the root password used when you installed Linux. apt-get install
uses the Advanced Package Tool to search for, retrieve and install software packages for Linux - this makes installation of much standard software in Linux easy.ifconfig
command, which will give results something like this:sudo apt-get install sun-java6-jdk
sudo update-java-alternatives -s java-6-sun
sudo nano /etc/environment
JAVA_HOME=/usr/lib/jvm/java-6-sun-1.6.0.14/
sudo apt-get install unzip
will provide that capability. Next, you can download GeoServer.cd /usr/share
wget
-
sudo wget http://downloads.sourceforge.net/geoserver/geoserver-1.7.6-bin.zip
sudo unzip geoserver-1.7.6-bin.zip
chown
will change ownership, using -R
makes it recursive through subfolders and files:sudo chown -R geoserver_username geoserver-1.7.6
would change all files and directories to be owned by the user specified (geoserver_username
as a placeholder).ls
and navigate directories using cd
.GEOSERVER_HOME="/usr/share/geoserver-1.7.6"
- again, you could do this using nano
to edit /etc/environment
- and there are also plenty of other ways to do this. You could also define other parts of GeoServer, such as GEOSERVER_DATA_DIR
at this point as well - consult the GeoServer docs for details there... http://docs.geoserver.org/1.7.x/en/user/cd
to the /bin
directory under your geoserver install, e.g. cd /usr/share/geoserver-1.7.6/bin"
and launch the startup script sh startup.sh
and voila... You will see some program output scroll by,[main] INFO org.mortbay.log - Started SelectChannelConnector@0.0.0.0:8080
- this should tell you that the GeoServer Jetty container is up and listening for connections on 8080.http://192.168.2.125:8080/geoserver/
and after an initial "loading" screen you should get the GeoServer web interface:
Here's another exiting bit of news - my firm is teamed with CGI Federal on USEPA's Software Engineering & Specialized Scientific Support (SES3) Contract, and we just got word that our team has won EPA's Central Data Exchange (CDX) task. This is very exciting news, CDX and the Exchange Network serve the community via facilitating exchange of a wide variety of environmental data between federal, state, tribal and other partnerships - it is a partnership that has proven itself to be tremendously effective and a great model for other types of data exchanges as well.
What I am particularly excited about is in leveraging the infrastructure that has already been built toward more robustly supporting geodata services, and ultimately toward enhanced reporting, metrics, analytical capabilities, and other capabilities to support feds, states, tribes and others in informed decisionmaking toward environmental policy and stewardship.As such - we also anticipate we will be looking to grow as a company, and will be looking to hire additional technical gurus with capabilities in data exchange, data management and data flows, particularly if you have prior capabilities and knowledge of EPA's Exchange Network and CDX, and/or geospatial technology.
If you are interested, drop me a line at dsmith (at) synergist.tech.com
The last several weeks have been quite hectic - busy on a number of fronts, which is a thankful thing, given the economy has slowed down a bit - but here is something quick that I wanted to share - I was awarded "Most Valuable Professional" (MVP) status by Microsoft for some of my ongoing work in Virtual Earth. Hierarchically, there isn't exactly a "VE MVP" program, but VE falls within Microsoft's broader Live Platform.
Some late night discussion with @GeoBabbler (Bill Dollins) and others last night led to this little flight of fancy... Bill was wondering if there were still any old copies of ArcView 1.0 around. Being a GIS geezer and a bit of a technology packrat, it turns out I still had a copy. Scary. As @FantomPlanet suggested, I reckon I have a bit of a Museum of GIS Antiquity going on - I believe I actually still have ancient copies of MapInfo, Atlas, GeoMedia, AutoCAD Map 1.0 and others floating around, plus quite a bit of hand-coded stuff from the days when COTS GIS was not even widely available.
ESRI Federal User Conference Highlights
My recently-retired EPA friend and colleague Dave Wolf was the recipient of the "Making a Difference" award. Dave was involved in pioneering efforts in web mapping at EPA, with EnviroMapper and other efforts.
I unfortunately arrived a bit late, and missed the discussion of ArcGIS Explorer Build 900 - fortunately Jithen Singh has a good overview of it here: http://mandown.co.nz/esri/arcgis-explorer-build-900-showcased-at-the-esri-federal-user-conference-2009/
As I arrived, I noted that there was a big focus being put on integration between ArcGIS and remote sensing imagery capability, specifically with ENVI and IDL: http://www.ittvis.com/ProductServices/ENVI.aspx. Dan Zimble led into presentations showing some of this capability, particularly integration of IDL scripts with ModelBuilder
Other highlights and demos:
I'm planning on attending at least part of the ESRI Federal User Conference next week - it's always good to get together with others working in the Federal community, to cross-pollinate ideas, talk, and see all the great things going on...
The details, from: http://www.esri.com/events/feduc/
If you are also attending and want to meet up, by all means, drop a line - dsmith (at) synergist-tech.com - while I have a few meetings, both inside, during FedUC, and a few outside meetings in the DC area next week, I will generally try to make FedUC my base of operations and will blog wherever conditions permit (if conference WiFi is available and/or my AT&T 3G service cooperates).GIS: The Geographic Approach for the Nation
Explore what geographic information system (GIS) technology can do for your agency at the largest geospatial conference dedicated to federal government. Whatever your GIS experience, the FedUC will give you the knowledge and resources you need to apply geography to problem solving, decision making, and accomplishing your missions.Join other leaders, decision makers, and GIS professionals February 18–20, 2009, in Washington, D.C.
February 18–20, 2009
Walter E. Washington Convention Center
Washington, D.C.Agenda-at-a-Glance
2009 Agenda [PDF]
Wednesday, February 18
9:30 a.m.–3:00 p.m. Plenary Session 2:30 p.m. Keynote Speaker 3:00 p.m.–6:00 p.m. GIS Solutions EXPO and Map Gallery Reception Thursday, February 19
8:30 a.m.–5:30 p.m. Concepts of GIS Sessions Paper Sessions Technical Workshops 8:30 a.m.–5:30 p.m. Map Gallery 8:30 a.m.–6:00 p.m. Hands-On Learning Center 10:00 a.m.–4:00 p.m. GIS Solutions EXPO 4:00 p.m.–5:30 p.m. Industry Focus Session 5:30 p.m.–8:30 p.m. Thursday Night Social Friday, February 20
8:30 a.m.–noon Paper Sessions Technical Workshops Industry Focus Sessions 9:30 a.m.–5:00 p.m. User Group Meetings Noon–2:00 p.m. Closing Session Who Should Attend and Why
Take the Geographic Approach
The FedUC is the ultimate resource when it comes to using geospatial technology in government. The conference offers presentations from technical and industry experts, valuable insight from your colleagues, and the latest solutions that fit your agency. Professionals across organizations are invited to discover effective and efficient ways to meet goals, overcome challenges, and address issues.
What You'll Experience
- Hear from Jack
Explore the future of GIS in government with ESRI president Jack Dangermond during the Plenary Session. Listen to him and a team of experts share what you can do with ArcGIS 9.3 in your organization. Plus, watch real-world demonstrations of ways government agencies are leveraging GIS.- Stay up-to-date
Learn about the newest ArcGIS tools and capabilities. Hear firsthand from ESRI staff, your peers, solution providers, and consultants as you attend paper sessions, technical workshops, and the GIS Solutions EXPO.- Network with your colleagues and ESRI staff
Build relationships with government and GIS professionals from both the public and private sectors as well as ESRI staff and business partners. Connect during sessions, exhibit times, and the evening reception.- Increase your knowledge of GIS
Discover more about how GIS works and what it can do for your team and agency. See ways GIS is being used—from data sharing to security to budget control. Attend presentations given by professionals from across the nation and learn about successful implementations, best practices, tips, and tricks.- Learn how to meet your agency’s needs
From compliance and accountability to visualizing patterns and trends, find out how taking the geographic approach improves your operations and decisions. Whether you work in federal, state, or local government, see how GIS can meet your organization’s unique needs.- Examine the most advanced technology
Experiment with state-of-the-art tools you can use right away. Learn about recent developments for geotechnologies in your fields, from hardware, software, and data solutions to innovative applications and services.- Get your questions answered
Pose your questions about GIS software, data, and implementation to ESRI staff members. Meet for a quick one-on-one discussion or set up a meeting to brainstorm and discuss project plans.See geography in action.
With news of Vivek Kundra joining the Obama administration to serve the Office of Management and Budget (OMB) as their top IT visionary, it brings me great encouragement. Vivek Kundra has been serving as the District of Columbia’s Chief Technology Officer, and he recently created some excitement through his Apps for Democracy initiative, where he pursued development of an “Open Data Catalog” containing over 250 data assets of various flavors (e.g. XML, Text/CSV, KML, ATOM/GeoRSS and ESRI Shapefile formats), and then promoted a contest wrapped around the Open Data Catalog, for development of innovative mashup-oriented applications.
In just a short amount of time, 47 excellent applications were submitted, dealing with a broad range of topics and providing many innovative solutions, a great success.
The Office of Management and Budget (OMB) is a Cabinet-level office, and is the largest office within the Executive Office of the President of the United States (EOP). It is an important conduit by which the White House oversees the activities of federal agencies. OMB is tasked with giving expert advice to senior White House officials on a range of topics relating to federal policy, management, legislative, regulatory, and budgetary issues. The bulk of OMB's 500 employees are charged with monitoring the adherence of their assigned federal programs to presidential policies. OMB performs its coordination role by gathering, filtering, and promulgating the President's annual budget request, by issuing bulletins, memoranda and circulars dictating agency management practices, by overseeing the "President's Management Agenda", and by reviewing agency regulations.
As pressures of economics and tightening budgets, increasing population and infrastructure demands, and limited resources continue to confront states, municipalities, and the nation as a whole, some harsh realities begin to emerge, of how much we can actually, pragmatically accomplish.
As just one example of this, studies of number of vehicle lane miles traveled, compared to number of vehicle lane miles constructed and maintained shows a clear divergence, and sends the message that demand by far has been outstripping supply:
One solution to this would be to just try and keep building roads everywhere – however this is a simplistic, and ultimately unsustainable solution. Certainly, we DO need to stabilize current infrastructure and address some critical physical issues of capacity bottlenecks, and in some instances we do need to improve circulation and flow in existing transportation networks. But we also need to change our thinking, in terms of how we assess, monitor and manage traffic and congestion.
Here, approaches such as use of Intelligent Transportation Systems can provide better visibility into traffic issues and offer solutions toward better management of the transportation network.
Via any number of technologies, such as embedded sensors, cameras, on-board systems and GPS, message boards and other forms of providing traffic advisory data, and hazards monitoring, traffic crises can be averted, congestion can be managed, and traffic rerouted to make optimal use of existing transportation networks. The use cases for embedded technology are numerous – while repairing or replacing our crumbling bridges, we can consider technologies to monitor bridge decks for icing conditions, and so on. We can utilize available traffic data along with spatial, temporal and predictive analysis, e.g. virtual origin-destination studies and other approaches to recognize patterns and trends, toward avoiding traffic jams or even conditions which may be prone to promoting accidents.
As another example, decades of poor, unsustainable planning, zoning, and land development practices have promoted suburban sprawl, pedestrian-unfriendly areas, dependence on cars for even the most mundane of errands, particularly as residential and commercial areas have become separated from each other in artificial models. In some areas, this has been recognized, as we see a return in some locales to “town center” concepts, where residents can find amenities within walking distance. Here again, proper tools and geospatial data are required by planners to correct these planning paradigms on a macro scale to recognize these bedroom community relationships, as well as on a micro scale, for example to best maximize pedestrian travel and optimize these local networks.
Additionally, we need to continue to promote mass transit options, aligned to serve core needs – commuters, shopping, and similar needs, based on observation of current traffic flows. If mass transit becomes enough of a convenience factor, it will continue to be utilized. Similarly, other mass-transit-related infrastructure needs to be examined. Here, spatial and temporal analysis of the network can reap great benefit toward maximizing mass transit networks and flows, their alignment to need (supply and demand for transit) and their efficiency.
These types of solutions are in need all around us - for example, as a regular visitor to the Washington, DC area, I often use their otherwise-excellent WMATA Metro system – however many demand issues and patterns rapidly become evident to even the casual eye– in out-lying areas served by the Metro, most of the parking lots and garages fill immediately in the AM and become deserted after work hours – a sign that commuters from outlying areas. To anyone arriving at, say, 10AM, there’s a good likelihood that some of these parking facilities will be long filled, forcing potential users to travel further before being able to avail themselves of mass transit. Here again, in even just expanding parking capacity, exists opportunity lost to get traffic off of the streets.
Even these types of things relating to commuting via Metro can also tie into Intelligent Transportation Systems, by providing parking advisories (e.g. saving commuters the grief of trying to find a space in a particular lot when parking may already be full) or by advising pedestrians right at street-level when the next train is arriving or of capacity issues (particularly when it may actually be worthwhile to just walk a few blocks to a different station); or by allowing better means of assessing travel options via web and/or location-aware mobile devices. Here, geospatial approaches can even allow users to get custom travel directions and planning via walking, mass transit, or for handicapped persons, routing via ADA curb cuts, avoidance of stairs, steep inclines, and other useful information toward ensuring safe and reasonable travel, even delivered directly to their phone or other mobile devices.
With HR1 and discussion of massive infrastructure investments on the horizon, we strongly need to consider an integrated strategy and investment for integrated data and analysis, to include remote sensing, geospatial, temporal and others - to go hand-in-hand with hard, bricks-and-mortar infrastructure investments – such that we may better manage the assets. And yes, this could be done independently in dozens of disparate efforts, but would be best leveraged through discourse and technical coordination and information sharing on a broader scale to leverage planning capabilities, modeling, and much more; again, it points up the need for a national vision and strategy for spatial data infrastructure.
If we are going to do this at all, we need to get it right.
While efforts remain local, we need a paradigm shift on many levels- to think beyond our traditional project-by-project approach, and think on a bigger level, to integrate IT into our planning process, as well as integrating it directly into our bricks-and-mortar infrastructure investments, and to better coordinate and leverage investments and efforts to provide this long-term benefit.
< >
In considering the current state of geospatial data in the nation, it runs the gamut. A substantial amount of data is collected and developed at the local level. Some is collected and developed at the state and federal level, some by tribes, some by academia, some by non-profits, and some by private sector. Some of this data is generated on a regular basis, as part of an established program; some is purely on an ad-hoc basis. Some is mandated, such as some of the data collected on environmental data through the National Environmental Information Exchange Network, some is collected, purely incidental to other activities.Some datasets exist on a national basis, some do not. And all throughout, there are myriad overlapping use cases, which may additionally place differing requirements on datasets. For example, in some cases, a roadway GIS dataset may be geared to roadway maintenance needs; in others, toward network and traffic analysis. In some cases, the requirements, dataset characteristics and attributes can converge and be accommodated in a single dataset. In others, they may not be able to converge, but the needed datasets can be developed by means of value-added attributes or joins. In some cases, derivative data is required. In many cases, there is tremendous need for consistency and authoritative datasets.
The landscape that quickly begins to emerge is one which is a patchwork, full of seams, overlaps, disjoints, gaps and disconnects- but- also one which holds much potential for leveraging disparate investments, and providing economies of scale, along with increasing richness of data, increased update frequency, increased accuracy and completeness.
How can these gaps and disjoints be bridged? Through a framework, forum and national dialogue, bringing together stakeholders at all levels – federal, state, local, tribal, academia, non-profit, and industry; through partnerships; through collaboration - organizations like NSGIC, like Federal and other agency GIS workgroups, like CUAHSI and many others. This is what holds a National Spatial Data Infrastructure together and brings success.
With considerable debate and controversy, HR 1, the Stimulus bill has passed in the House of Representatives and has moved on to the Senate for additional debate and deliberation.
Recently there has been a great deal of discussion about "NSDI 2.0" - and yet it seems there is much confusion about what it is or isn't - and what we should do, or whether we should bother discussing it at all.
History
To step backward in time, it primarily deals with National Spatial Data Infrastructure from a federal perspective, as enacted through the Office of Management and Budget Circular A-16.
This document was originally issued in 1990, followed by Presidential Executive Order 12906, and then subsequently updated in 2002 (which incorporated EO 12906).
OMB Circular A-16 (as revised 2002)
In its present form, the NSDI (if you were to consider it NSDI 1.0) consists of: