Conversion of a shapefile to oracle spatial format

hi,
I have got installed oracle9i, arcgis9 and sde9 on my system. I am using direct connection technique. i have tried to export shapefile to geodatabase with the use of SDO_GEOMETRY configuration keyword. But when i am checking at the backend there is no srid value for the exported shapefile in mdsys.sdo_geom_metadatatable.

Hello Vaneeza:
We also have the software versions that you mention. how did you load your data from the shapefile to your Oracle database? Did you use the shp2sdo.exe program? If so, then you need to complete this data load by logging into Oracle as the same account used to load the shapefile data and execute a SQL statement (INSERT...) to insert the metadata into the USER_SDO_GEOM_METADATA table. See the Oracle Spatial Users Guide and Reference for more information. I believe the book "Pro Oracle Spatial" covers this topic also. I think you will also have to register the table with ArcSDE, there is an ArcSDE command for this. By default, ArcSDE has something called "autoregistration" turned on, so unless you have changed that setting, then ESRI client apps like ArcMap will "discover" the table in your Oracle database by reading the Oracle metadata.
R Clement

Similar Messages

Convert shapefile to oracle spatial

Hi All,
I have a road network which is shapefile format and i want to export it to oracle spatial format using any free tool, any suggestion or guidance would be highy appretiated. I am using arcgis 9.3.1 and Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bi,
Best Regards,
Mich

Hi Mich,
That must be one of the most commonly asked questions on this forum, so have a search for "shape" and you won't be short of ideas.
A Google search will also give you countless suggestions. https://www.google.com/search?q=oracle+spatial+shape+file
For a GUI driven tool, I would recommend using the GeoRaptor plugin for SQLDeveloper which has an excellent shape file importer/exporter (http://sourceforge.net/projects/georaptor/).
John

Loading shapefiles into Oracle Spatial

Fellow Oracle Spatiallers!
Currently we edit Oracle Spatial data by checking data out into a shapefile,
making our changes off-line, and reloading the shapefile back into Oracle.
Instead of using the Oracle Spatial supplied tool, we decided to purchase
a utility called the "Spatial Loader" from a company called Geometry Pty Ltd
(http://www.geometryit.com). There are a number of reasons why we decided to
go that way which might become evident from the command line parameters of
this utility:
Usage: Shp2Spt [Arguments] [Options]
OR
Usage: Java com.geometryit.spatialloader.oracle.AdvancedJavaSpatialTranslator [Arguments] [Options]
[Arguments] must specify these values:
-o create
type of operation to perform
create creates a new table, must not exist already
recreate creates a new table, may exist already
init drops existing table, creates a new one
append appends data onto existing table
-f <shape_file>
the shape file or project to translate
-l <table,column>
target table and column for the geometry data
-D <database>
target database name
-u <username>
username for RDBMS
-p <password>
password for RDBMS
[Options] values are not necessarily required:
-s <server_name>
name of server with database
-port <port_number>
the port to connect to on the server
-ufi <column_name>
specify the name of the UFI field (unique ID)
-seq <sequence_name>
specify the sequence to use for the spatial data unique IDs
-a none
attributes mode
none no attributes will be transferred
all all attribtues will be transfered as found
file= file containing lines of the form:
<shape_attribute><space/tab><rdbms_column>
where
<shape_attribute> selects the column to be output
<rdbms_column> name of the column in RDBMS
-srid <id>
specify the Spatial Reference ID for the spatial data
(this must be set to use Spatial Reference Transformations)
-i [<level>] or -i rtree
create an index for the generated table
the <level> parameter is an optional integer
representing the depth of the quadtree created
if rtree is specified, the index created will be
an rtree
-c <commit_interval>
number of rows to commit after
-t <tolerance>
tolerance value for metadata
-r none
used to determine number of decimal places to round vertices to
if you use the tolerance-parameter option, specify the -t parameter before -r
-igc
ignore geometry collections
-sgc
split geometry collections
-sgd f
split geometry direction [forward | reverse]
-update-metadata <true/false>
update the Oracle Spatial Metadata table after loading data
-validate <true/false>
perform Oracle Spatial validation after loading data
-v
verbose mode on
-h or -?
display this help message
The main things I like about this tool are:
1. One step (no conversion to sqlloader form followed by a call to the sqlloader).
2. The ability to round the coordinates of the shapes in the shapefile by applying
the XY tolerance values held in the SDO_GEOM_METADATA table.
This is quite important because our editing package - due to double/single precision
issues - can actually move coordinates but those movements are sub the precision of
the actual data. By rounding to the nominate precision we can detect situations where
no actual change to the shape (and its attributes) was made and thus not create superfluous
revisions within the database.
3. It will correctly re-wind the coordinates of the outer/inner shells of polygons. This is
important as ESRI shapefiles are agnostic on the winding order: an outer shell coordinates
can be listed in either clockwise or anti-clockwise order.
4. You can specify the primary key (UFI) column (numeric) and an Oracle Sequence number such
that each new shape loaded can have its UFI assigned from that sequence.
Because of this flexibility, and the excellent support (it is a purchasable product) from the
developers, I can heartily recommend this loader to fellow Spatiallers. It is worth every
penny I spent on it. Try the free version on their website and if, like me, you like it,
purchase it!
regards
Simon

Hi Shuan,
As part of the zip file created for the next training course to be posted for Oracle Spatial on OTN (within the next few weeks) there is a free (unsupported, undocumented) version of a shape to sdo converter. This should work, but it is unsupported. It will create a layer that then needs to be migrated into 8.1.6 format.
If you need it quite soon send email to [email protected] and I can get it to you.
Hope this helps,
dan

Import a shape file to oracle spatial format within an oracle pl/sql proced

hi,
My task is to import an esri sde shape file to oracle sdo format within pl/sql procedure.
i am using oracle 10g, arcgis 9 and arcsdo, geometry type is line, please anyone could help how can i achieve this task, would be very thankful
Best Regards,

There are no "in database" tools around that do this AFAIK. Most/all tools are external to the database and have to be invoked externally.
If you created an external "batch file" that did the right processing, you would still have to work out how to execute this batch file from within Oracle. AFAIK the standard method is to use create custom code that uses DBMS_PIPE to communicate with the operating system to execute the batch file. DBAs hate this approach and it does require programming.
The other method could be to write a trivial piece of Java that when passed the full path to the batch file executes the file. You would then load the compiled Java class into the Oracle JVM and then create a simple PL/SQL wrapper around it. I can't do it at the moment, but can come back with the code and instructions later on in the week.
<SHAMELESS PLUG>
As an aside (it seems appropriate to mention this now), I have been developing tools that do run inside the Oracle JVM an can export Oracle data (including sdo_geometry) to a number of formats:
* xSV (ie comma separated, tab separated, any other single character)
* Excel Spreadsheet
* ESRI Shapefile (including the writing of the PRJ file using a user supplied PRJ string and also I write a MapInfo TAB file to "wrap" the shapefile).
When exporting to xSV or Excel Spreadsheet one can chose to encode the SDO_GEOMETRY data as GML or WKT.
(I am working on a KML exporter as well.)
However, note that these tools EXPORT data and do not IMPORT data.
The tools, currently are running in production at a customer site (tabbed shapefile export option) and work well. Export jobs are defined and given to the Oracle JOB or SCHEDULER and correctly run at the appropriate time writing the data to an operating system directory defined internally (with appropriate permissions) as an Oracle Directory object.
I am now considering selling the exporter tool and am looking for testers. (The pricing of these tools will be exceedingly low.)
</SHAMELESS PLUG>
Now, while I hadn't planned to write any importer for a shapefile for my Exporter, I might consider it if you get stuck and can't find a satisfactory tool.
regards
Simon

ADC Worldmap v5.1 now available in Oracle Spatial 10G format..

Check out www.adcworldmap.com, full world coverage.
Detail rich layers can be turned on or off according to priority and zoom levels making ADC WorldMap Version 5.1 and ideal product for a variety of international applications.
* Administrative Boundaries - National and Sub-National Boundaries for the entire world (including states, provinces, districts, regions, etc.)
* Airports - including Airport Codes
* Capitals of the World
* Cities, Towns, Villages - with Population (if known)
* Railroads - Track, Stations and Yards
* Roads - Motorways, Primary Routes, Important Routes, Main Routes and Other Routes
* Plus Many More Layers! ...
pricing info on page.

OOOOps...
Product in testing phase right now, availability in Oracle Spatial format soon.
I will announce when ADCI informs us.
thanks
Steve

DigitalGlobe Sample Imagery in Oracle Spatial Georaster format

"Sample data from Digital Globe for Oracle Spatial GeoRaster"
DigitalGlobe Sample Imagery - Oracle Spatial formatted (GeoRaster) imagery of San Francisco.
More cities will be added soon.
http://www.oracle.com/technology/products/spatial/htdocs/spatial_partners_downloads.html#data

Ok, good stuff.
I downloaded it, but there is little documentation on how to get it in to Oracle.
I tried to use the impdp utility, but got a ORA-39059: dump file set is incomplete
after unzipping all the files in the import directory.
Any ideas?

Oracle Spatial Training Documentation

I have to give some Oracle Spatial formation and i need some material to build this course.
Where could i find this kind of document?
....thanks for your help

Thanks for the advice but i already did that kind of research. I found some documentation but nothing from Oracle.
Im working for a company that is a "Certified Advantage Partner" (OPN PIN: 147582435711). Can i have acces to some Training Documentation on Oracle Spatial or to some Oracle spatial training from Oracle University?
Im sure that Oracle has some PPT files on Oracle Spatial.
.....thanks for your help

Conversion of white spaced flat file to oracle table format

hello friends
I have found out that SQL*Loader can load data from .txt format into table format in oracle.
Please if anynone can provide me with the syntax for conversion of white spaced data in text format would be of great help
Regards,
-Mahesh

The utilities guide provides some sample cases.
Just change the field terminator and adjust the field definitions
http://download-west.oracle.com/docs/cd/B10501_01/server.920/a96652/ch10.htm#1006689

How to convert oracle spatial to Shapefile ?

I have download the shp2sdo and convert the shapefile for GIS to Oracle spatial.Now i want to convert it back to shapefile.How do to that?Which feature in Oracle i can do that?
Hope to get a response.

There are a lot of other threads that have this discussion, although I can't understand why anyone would want to do such a thing :^)
Spatial -> Shapefile
SDO_geometry to ESRI Shapefile
Re: Export to shapefile (.shp) and .dbf
and others...
hope this helps.

Help define the requirements for an Oracle Spatial management tool

Hi,
We are developing a tool that, we hope, will be indispensable for all Oracle Spatial and Locator dbas/users. We've released version 1.0, but we need your help to define the requirements for the next version.
What features would you like to have in a management tool for your spatial databases?
The features we've got so far:
1. Viewing of vector data in a map + attributes
2. Loading from shapefiles
3. Exporting to shapefiles
4. Validating metadata, indexes and spatial data.
We are adding editing of vectors in the next version - basic stuff for add, update and delete.
But there must be a lot more. What do you find difficult to do in Oracle Spatial/Locator? What would you like in a tool such as this?
Any feedback either to myself or the forum is much appreciated.
cheers,
Andrew
[email protected]
PS If you like to have a look at what we have done so far, go to http://www.geometryit.com/products/spatialConsole.php

Andrew knows what I have asked for but for others to think about and to start
the ball rolling, here's what they are:
1. Ability to enter own SQL commands but with PARAMETERS for attributes
and shapes as in the following examples:
SELECT ...
FROM my_spatial_table a
WHERE a.ATTRIBUTE = :attr
AND MDSYS.SDO_RELATE(a.shape,:polygon,'mask=anyinteract') = 'TRUE'
When executed the attribute value is asked for via a input box (data type?)
and the user is asked to define the SDO_GEOMETRY for the :polgygon parameter via mouse clicks on the screen.
Similarly, this would work for INSERT, UPDATE and DELETE...
INSERT INTO my_spatial_table (shape) values(:polygon)
The data type of an attribute parameter could be determined in two ways:
a) By querying the Oracle catalog;
b) By using a "PARAMETERS" command before the query as follows
PARAMETERS name type [(size)] [, name type [(size)] ...]
The PARAMETERS declaration has these parts:
name     The name of the parameter.
type     The type of the parameter.
size     The size of the parameter in characters or bytes.
2. When executing an SQL SELECT statement I would like the tool
to suggest the HINTS that are needed to improve performance.
3. Following on from 2, I would like to Tick an option that would return the
EXPLAIN PLAN that the query optimizer used when executing my query.
4. The tool has to support ALL Oracle's spatial vector data types.
5. It would be nice to be able to work with GeoRasters. Since Spatial Console
imports/exports shapefiles why not the same for rasters. However, the problem
with supporting foreign data formats is WHERE DO YOU STOP!!!!!
6. You could allow for the styling of the Spatial Console to be stored in the MapViewer catalogs or use the MapViewer catalogs when styling an Sdo_Geometry if it exists (I note that your tool extracts the SDO_METADATA
why not the MapViewer metadata as well)?
regards
S.

Oracle spatial datasets

Are there any sites from where i can get spatial data that can be downloaded to Oracle Spatial. I am doing project on spatial datawarehousing, so need some real data on climatic conditions for some span of time. I have searched a lot on google but can not find a good one. May be you can help me
thanks

All you can do is find sites that have shapefiles or GML for download
and then use the appropriate loader to put into Oracle.
There are NO sites that I know of that make data available in Oracle exporter format.
S.

Oracle Spatial Performance with 10-20.000 users

Does anyone have any experience when Oracle Spatial is used with say 20.000 concurrent users. I am not interested in MapViewer response time, but lets say there is:
- an app using 800 different tables each having an sdo_geometry column
- the app is configured with different tables visible on different view scales
- let's say an average of 40-50 tables is visible at any given time
- some tables will have only a few records, while other can hold millions.
- there is no client side caching
- clients can zoom in/out pan.
Anwers I am interested in:
- What sort of server would be required
- How can Oracle serve all that data (each Refresh renders the map and retrieves the data over the wire as there is no client side caching).
- What sort of network infrastructure would be required.
- Can clients connect to different servers and hence use load balancing or does Oracle have an automatic mechanism for that?
Thanks in advance,
Patrick

Patrick, et al.
There are lots of things one can do to improve performance in mapping environments because of a lot of the visualisation is based on "background" or read-only data. Here are some "tips":
1. Spatially sort read-only data.
This tip makes sure that data that is close to each other in space are next to each other on disk! Dan gave a good suggestion when he referenced Chapter 14, "Reorganize the Table Data to Minimize I/O" pp 580- 582, Pro Oracle Spatial. But just as easily one can create a table as select ... where sdo_filter() where the filtering object is an optimized rectangle across the whole of the dataset. (This is quite quick on 10g and above but much slower on earlier releases.)
When implementing this make sure that the created table is created such that its blocks are next to each other in the tablespace. (Consider tablespace defragmentation beforehand.) Also, if the data is READ ONLY set the PCTFREE to 0 in order to pack the data up into as small a number of blocks as possible.
2. Generalise data
Rendering spatial data can be expensive where the data is geometrically detailed (many vertices) esp where the data is being visualised at smaller scales than it was captured at. So, if your "zoom thresholds" allow 1:10,000 data to be used at 1:100,000 then you are going to have problems. Consider pre-generalising the data (see sdo_util.simplify) before deployment. You can add multiple columns to your base table to hold this data. Be careful with polygon data because generalising polygons that share boundaries will create gaps etc as the data is more generalised. Often it is better to export the data to a GIS which can maintain the boundary relationships when generalising (say via topological relationships).
Oracle's MapViewer has excellent on-the-fly generalisation but here one needs to be careful. Application tier caching (cf Bryan's comments) can help here a lot.
3. Don't draw data that is sub-pixel.
As one zooms out objects become smaller and smaller until they reach a point where the whole object can be drawn within a single pixel. If you have control over your map visualisation application you might want to consider setting the SDO_FILTER parameter "min_resolution" flag dynamically so that its value is the same as the number of meters / pixel (eg min_resolution=10). If this is set Oracle Spatial will only include spatial objects in the returned search set if one side of a geometry's MBR is greater than or equal to this value. Thus any geometries smaller than a pixel will not be returned. Very useful for large scale data being drawn at small scales and for which no selection (eg identify) is required. With Oracle MapViewer this behaviour can be set via the generalized_pixels parameter.
3. SDO_TOLERANCE, Clean Data
If you are querying data other than via MBR (eg find all land parcels that touch each other) then make sure that your sdo_tolerance values are appropriate. I have seen sites where data captured to 1cm had an sdo_tolerance value set to a millionth of a meter!
A corollary to this is make sure that all your data passes validation at the chosen sdo_tolerance value before deploying to visualisation. Run sdo_geom.validate_geometry()/validate_layer()...
4. Rtree Spatial Indexing
At 10g and above lots of great work went in to the RTree indexing. So, make sure you are using RTrees and not QuadTrees. Also, many GIS applications create sub-optimal RTrees by not using the additional parameters available at 10g and above.
4.1 If your table/column sdo_geometry data contains only points, lines or polygons then let the RTree indexer know (via layer_gtype) as it can implement certain optimizations based on this knowledge.
4.2 With 10g you can set the RTree's spatial index data block use via sdo_pct_free. Consider setting this parameter to 0 if the table/column sdo_geometry data is read only.
4.3 If a table/column is in high demand (eg it is the most commonly used table in all visualisations) you can consider loading (a part of) the RTree index into memory. Now, with the RTree indexing, the sdo_non_leaf_tbl=true parameter will split the RTree index into its leaf (contains actual rowid reference) and non-leaf (the tree built on the leaves) components. Most RTrees are built without this so only the MDRT*** secondary tables are built. But if sdo_non_leaf_tbl is set to true you will see the creation of an additional MDNT*** secondary table (for the non_leaf part of the rtree index). Now, if appropriate, the non_leaf table can be loaded into memory via the following:
ALTER TABLE MDNT*** STORAGE(BUFFER_AREA KEEP);
This is NOT a general panacea for all performance problems. One should investigate other options before embarking on this (cf Tom Kyte's books such as Expert Oracle Database Architecture, 9i and 10g Programming Techniques and Solutions.)
4.4 Don't forget to check your spatial index data quality regularly. Because many sites use GIS package GUI tools to create tables, load data and index them, there is a real tendency to not check what they have done or regularly monitor the objects. Check the SDO_RTREE_QUALITY column in USER_SDO_INDEX_METADATA and look for indexes with an SDO_RTREE_QUALITY setting that is > 2. If > 2 consider rebuilding or recreating the index.
5. The rendering engine.
Whatever rendering engine one uses make sure you try and understand fully what it can and cannot do. AutoDesk's MapGuide is an excellent product but I have seen it simply cache table/column data and never dynamically access it. Also, I have been at one site which was running Deegree and MapViewer and MapViewer was so fast in comparison to Deegree that I was called in to find out why. I discovered that Deegree was using SDO_RELATE(... ANYINTERACT ...) for all MBR queries while MapViewer was using SDO_FILTER. Just this difference was causing some queries to perform at < 10% of the speed of MapViewer!!!!
6. Consider "denormalising" data
There is an old adage in databases that is "normalise for edit, denormalise for performance". When we load spatial data we often get it from suppliers in a fairly flat or normalised form. In consort with spatial sorting, consider denormalising the data via aggregations based on a rendering attribute and some sort of spatial unit. For example, if you have 1 million points stored as single points in SDO_GEOMETRY.SDO_POINT which you want to render by a single attribute containing 20 values, consider aggregating the data using this attribute AND some sort of spatial BUCKET or BIN. So, consider using SDO_AGGR_UNION coupled with Spatial Analysis and Mining package functions to GROUP the data BY <<column_name>> and a set of spatial extents.
6. Tablespace use
Finally, talk to your DBA in order to find out how the oracle database's physical and logical storage is organised. Is a SAN being used or SAME arranged disk arrays? Knowing this you can organise your spatial data and indexes using more effective and efficient methods that will ensure greater scalability.
7. Network fetch
If your rendering engine (app server) and database are on separate machines you need to investigate what sort of fetch sizes are being used when returning data from queries to the middle-tier. Fetch sizes for attribute only data rows and rows containing spatial data can be, and normally are, radically different. Accepting the default settings for these sizes could be killing you (as could the sort_area_size of the Oracle session the application server has created on the database). For example I have been informed that MapInfo Pro uses a fixed value of 25 records per fetch when communicating with Oracle. I have done some testing to show that this value can be too small for certain types of spatial data. SQL Developer's GeoRaptor uses 100 which is generally better (but this one can modify this). Most programmers accept defaults for network properties when programming in ADO/ODBC/OLEDB/JDBC: just be careful as to what is being set here. (This is one of the great strengths of ArcSDE: its TCP/IP network transport is well written, tuneable and very efficient.)
8. Physical Format
Finally, while Oracle's excellent MapViewer requires data its spatial data to be in Oracle, other commercial rendering engines do not. So, consider using alternate, physical file formats that are more optimal for your rendering engine. For example, Google Earth Enterprise "compiles" all the source data into an optimal format which the server then serves to Google Earth Enterprise clients. Similarly, a shapefile on local disk to the application server (with spatial indexing) may be faster that storing the data back in Oracle on a database server that is being shared with other business databases (eg Oracle financials). If you don't like this approach and want to use Oracle only consider using a dedicated Oracle XE on the application server for the data that is read only and used in most of your generated maps eg contour or drainage data.
Just some things to think about.
regards
Simon

How to display the data store in Oracle Spatial?

Hello everyone,
I am totally newbie in Oracle Spatial and to GIS in general. I have started playing around with Oracle Spatial and did an example which is to store a couple of polygons in Oracle and my question is: how to view/display the stored data (in my case the polygons) using Oracle?
Thanks in advance

Latvian83,
thing is, most of the GIS data out there are in SHAPE format so does it make sense to convert [between formats]Depends.
If you're a data producer that wants to ensure a single version of the truth across your company, then maintaining a central repository makes imminent good sense. The alternative would be people working on likely outdated snap-shots of data – stored on their PCs as well as duplicated on file-servers -- bumbling along creating derivatives and passing on the results as if they were valid... Anyhow, spatial analysts would also benefit from a single version of truth.
Data consumers who just want the latest mashups may not want to be bothered with the translation in/out of a database.
Then there’s a grey area with transformations: I've seem instances where it was more expedient to pull data into ArcMap for a massive transformation than performing a similar operation within Oracle.
Regards,
Noel
(I'm sure you've already found it, but you can right-click on a legend entry on ArcMap's Table of Contents and find the Export to ShapeFile option on the context-menu.)

Creating an Oracle Spatial database in 10g and connecting ArcGIS

I have a set of shapefiles that I want to convert into Oracle Spatial 10g and then be able to view these with the capability of ArcGIS 9 (without using ArcSDE).
From what I've read, I think this could be done by using ODBC. Once that connection is made, will I then be able to use the full functionality of ArcGIS especially read/write functions to edit the information in Oracle Spatial?
What data formats does Oracle Spatial in 10g support. I am concerned about raster data, CAD data, Survey data etc

The shape files can be loaded into Oracle spatial using shp2sdo.exe available on web.To view the GIS data in ArcGIS ,ArcGIS needs the layers to be registered.Therefore you need Arcsde for registering the layers.But for viewing the data in Arcgis we do not need arcsde ,we can view the data using direct connect.For editing the data we can use ODBC connection.
About raster data,we can load tiff,jpeg,bmp,png,gif using georaster tools provided by oracle into georaster tables.
Thanks
PC Rao

PostgreSQL/PostGIS to Oracle Spatial

Hi there,
I searched for this subject on the internet but could not find a solution to move a complete PostGIS database to Oracle Spatial. All information I found was about Oracle to PostGIS. Could anyone tell me how I can migrate to Oracle?
- Moving the table and field structure (including the projections)
- Moving the data
Many thanks in advance
telmessos

Telmessos,
I would recommend to use an intermediate format like shapefile. First export your tables (Including table structure and data) from the PostGIS using "PostGIS SHapefile Import/Export Manager" which is installed with postgis.
There are some tools to import shapefiles into oracle DB. The one I suggest here is the Georaptor which you can install it as a plugin in Oracle SQL Developer. Georaptor is opensource (free) and easy to use. You can download it from here:
http://sourceforge.net/projects/georaptor/files/
Regards,
Farid

Conversion of a shapefile to oracle spatial format

Similar Messages

Maybe you are looking for