Problem in loading large data to SDE using Shp2sde command

Hi,
When we try load data to SDE (Oracle 8.1.5, Sun solaris 2.6)using shp2sde command, we get the following error message and the data is loaded partially:-
" SDE: Shape #2560 is an invalid entity type for layer station.
3337 features converted
3337 features stored "
The shape file had 4352 features of type point.
If the same data is splitted into 2 (one having 1906 features and another having 2446 features), there is no problem in loading.
The giomgr.log file had the following lines corresponding to this
loading.
Process 9512, R/T calls 14, features read 0, wrote 3337, locks 0,
buffers 1, partial 0, buffered features 3337, buffered data 555K
We suspect this is due some size specified somewhere which limits
loading of all the data. So our DBA granted SDE user quota unlimited to SDE tablespace. After the granting, everything works fine, we can load the data. But when we restart the server, the same error appear again.
We are encountering this error in production but not in the devt environment. We urgently need to solve this problem. Anyone has solution to this problem?
Thanks.
null

<BLOCKQUOTE><font size="1" face="Verdana, Arial">quote:</font><HR>Originally posted by Gerjan Walrecht ([email protected]):
What is your commit interval? (-c ...)<HR></BLOCKQUOTE>
My commit interval is 1000. Even if I reduce the commit to 500, the result is still the same.
I was wandering is there anywhere where Oracle limit the size of the loading? or Kernel.. etc
null

Similar Messages

Problem in loading meta data !!!!

Hi,
While creating metadata in IDX2, I am getting communication error 'Error when opening an RFC connection' .
I have created port SAP<SYSTEM ID> and client no & giving rfc des of sap system in idx1 . and while loading meta data i an getting above error .
I able to load meta data if i use other (non sap ) port eg abc and usng   rfc des of sap system . but idocs are not reaching xi
What are the steps we should do for loading metadata by using sap port i.e client .
Please help me solve this problem
Thanks,
Sridhar

HI
ALE SETTINGS TO POST IDOC OUT OF SAP R/3
We need to do the following settings in XI
1)   Create an RFC Destination to the Sending System in transaction code (SM59)
a)   Choose create
b)   Specify the name of the RFC destination
c)   Select connection type as 3 and save
d)   In the technical settings tab enter the details SAP SID/URL and system number#
e)   Enter the Gateway host as same details above SID/URL
f)   Gateway service is 3300+system number#
g)   In the Logon /Security tab, enter the client user & Password details of Destination system
h) Test the connection and remote logon.Both should be succesful
2) Create Port Using Transaction Code IDX1
a)   Select create new button
b)   Enter the port name as SAP+SID (The starting char should be SAP)
c)   Enter the destination client
d)   Enter the RFC Destination created in SAP R/3 towards other system
e)   Save
3) Load Meta Data for IDOC Using transaction Using Transaction (IDX2)
a) Create new
b) IDOC Message Type
c) Enter port created in IDX1
                    SETTINGS IN SAP R/3
     We need to do the following settings in R/3
     Logon to Sap R/3 System
1)   Create an RFC Destination to XI in transaction code (SM59)
a)   Choose create
b)   Specify the name of the RFC destination
c)   Select connection type as 3 and save
d)   In the technical settings tab enter the details SAP SID/URL and system number#
e)   Enter the Gateway host as same details above SID/URL
f)   Gateway service is 3300+system number#
g)   In the Logon /Security tab, enter the client user & Password details of Destination system
h)   Test the connection and remote logon.Both must be succesful
2)   Create communication Port for Idoc processing Using Transaction(We21)
a)   First Select Transactional RFC and then click create button
b)   Enter the destination port name as SAP+SID (The starting char should be SAP)
d)   Enter the RFC Destination created in SAP R/3 towards other system.
e)   Save
3)   Create Partner Profile with Outbound Parameters (WE20)
a)   Create New
b)   Create the Partner no. name as same the logical system name of the destination system
c)   Select Partner type LS
d)   Enter details for Type: US/USER, Agent, and Lang
     Then Save
e)   Select Partner no. and LS which were create above
f)   Now we have to give some Outbound Parameters.So click on ADD TO Create Outbound Parameter
g)   Select Message type
h)   Double click on Message Type and Then Enter the details for Receiving port, Pack size=1 and Basic type
I)   save
4)   In Transaction SALE, Create Logical System
a). Go to Basic Settings-> First Define logical systems
     and then assign logical systems
b)   Double click on Define the logical systems
c)   Give data for your Logicaal System and Name
d)   Now click on Save.Here one window may appear just click on Continue.Now the Logical System name is ready
e)   Assign the logical system name to the client
5)   Create Customer Distribution model in the transaction code BD64
1)   Click on the Create modal View button and enter the short text, Technical name etc as shown below
2)   Now select the created model view and click on Add message type button .A pop up box appears, enter Sending system, receiving system and message type
3)   Save the Distribution model
    Generate Partner Profiles
Click on Menu Item Generate Partner Profiles
    It leads to the next transaction where in the selection screen you have to provide Model view name, Partner System logical system and execute
    Then, you will be intimated about the partners, port creation, and outbound parameters creation
4)   Distribute Customer Distribution Model
    In the menu item GO to Edit->Modal View-> Distribute to the destination client
    Popup window appears ,press Enter
You will be intimated about the the Modal View Distributed
PLZ REWARDS POINTS
VIKAS

Problem in loading transactional data from to 0MKT_DSO1(ods) to 0MKTG_C01

Hi,
I am trying to load lead transaction data to the standard Crm lead management cube from ODS.There is a problem while loading transaction data from 0MKT_DSO1(ods) to the infocube 0MKTG_C01 as the field 0STATECSYS2(CRM STATUS) is set to 10 in ods -meaning incorrect transaction. This feild is not there in the infocube.
There is a routine in the cube that deletes data records with (0statecsys2) set to 10.
THIS field is not coming in the transaction.
so, where can i see the master data in crm source system? and why is that feild getting set to 10 ?
thanks in advance!

Thanks for the reply..
I have checked the Fact table which shows
1. packet Dimension
2. Time dimension
3. Unit dimension.
I have kept the 0CALDAY as the time characteristics.
Sample data i have loaded from ODS to Cube.
Sample data in ODS.
Sales order No_____0CALDAY_____AMOUNT
800001___________12/02/2009____15
I have loaded this data in Cube with Full Upload.
Data in Cube.
Sales order No_____0CALDAY_____AMOUNT
800001___________12/02/2009____15
Again i am loading the same data to cube
Data in cube after loading.
Sales order No_____0CALDAY_____AMOUNT
800001___________12/02/2009____15
800001___________12/02/2009____15
The data is duplicated and it is not cumulating.
Am i missing anything on this.
Pls help..
Thanks,
Siva.

Problem with load XML data

Hi.
I have a problem this load XML data. For example: file name:
01-05-2008.xml => in this file all data have date=01.05.2008.
Once i load period 01.05.2008 to 10.05.2008 my app load 10 files.
Sometimes some row this greater date stay earlier then row this
smaller date. I don't know why this happend. Bellow part of code.
Please help.
P.S. sorry for my very bad english.

Hi Lekser,
ntsii is totally right.
Calling httpservice send is a async operation, which means
you don´t know when the result event of such operation will
return.
You can also sort your grid after a xml data file was loaded.
At least it would guarantee that the entries appear in the
right order.
best regards,
kcell

Need to load large data set from Oracle table onto desktop using ODBC

I don't have TOAD nor any other tool for querying the database. I'm wondering how I can load a large data set from an Oracle table onto my desktop using Excel or Access or some other tool using ODBC or not using ODBC if that's possible. I need results to be in a .csv file or something similar. Speed is what is important here. I'm looking to load more than 1 million but less than 10 million records at once. Thanks.

hillelhalevi wrote:
I don't have TOAD nor any other tool for querying the database. I'm wondering how I can load a large data set from an Oracle table onto my desktop using Excel or Access or some other tool using ODBC or not using ODBC if that's possible. I need results to be in a .csv file or something similar. Speed is what is important here. I'm looking to load more than 1 million but less than 10 million records at once. Thanks.
Use Oracle's free Sql Developer
http://www.oracle.com/technetwork/developer-tools/sql-developer/downloads/index.html
You can just issue a query like this
SELECT /*csv*/ * FROM SCOTT.EMP
Then just save the results to a file
See this article by Jeff Smith for other options
http://www.thatjeffsmith.com/archive/2012/05/formatting-query-results-to-csv-in-oracle-sql-developer/

Unable to use sqlloader to load large data into a varchar2 column..plz.help

Hi,
Currently the column in the database is a varchar2(4000) coulmn that stores data in the form of xml and data that has many carrriage returns.
Current I am trying to archive this column value and later truncate the data in this column.
I was able to create a .csv file but when using the sqlloder ,the utility fails as the data I am about to load has data stored both in the form of "xml" sometimes and sometimes as a list of attributes separated by newline character.
After several failed attempts... I would like to know if it can be achieved using sqlloader or if sqlloader is a bad choice and i should go for an import/export instead?
Thanks in advance...
-Kevin

Currently the column in the database is a
varchar2(4000) coulmn that stores data in the form of
xml and data that has many carrriage returns. Can I ask why your XML data has carriage returns in it? The nature of XML dictates that the structure is defined by the tags. Of course you can have CR's in your actual data between those tags, but if someone is hard coding CR's into the XML to make it look pretty this in not how XML was intended to be used.
I was able to create a .csv file but when using the
sqlloder ,the utility fails as the data I am about to
load has data stored both in the form of "xml"
sometimes and sometimes as a list of attributes
separated by newline character.It probably can be (can you provide a sample of data so we can see the structure) but you would probably be best revisiting the code that generates the CSV and ensure that it is output in a simpler format.

Problem while loading the data

Hi Gurus,
I am facing aproblem in PSA.Acctually the problem is that when we are loading the data from R/3 to BI side sold to party errors were occured.I edited that error records and manual update done.But in cube manage i find that trasfore records are only 6 which are edited in PSA and added recordrs are 2651.But in that datapacket total records are 3061.
My cube was rollup also.
pls give my solution.I'll assigne points.
Regards
Roy

Hi Raj,
No need to match datapacket total records to your target.Because depend on the design records are going to change.
Thnx,
Assign points if useful.

Safari keeps crashing when loading large data on web pages

I have owned my iPad 3 for more than a year now and I have never encountered this problem but ever since I have updated to the latest iOS version(7.1.1), my safari keeps crashing on my community site where threads have maybe over a 100 comments in them.
Now whenever I open a thread page on Safari, it loads for a few seconds then crashes, to make things worse for me is one in a while when it crashes, it reboots my iPad. I have seen several similar questions asked by other people regarding safari crashing when loading large amounts of data and got help saying that there's something wrong with the CSS. or something but I never got any idea on how to resolve this bug.
Can anyone tell me how do I prevent my Safari from crashing everytime I open a thread? Any solutions? Because I am getting really ******.
(Ps: I have already tried other browsing apps such as Google Search and Chrome, they still crash. I even tried letting it load half-way and then stopping it but it isn't going well.)

I have restored my iOS devices a number of times in order to resolve issues and it has gone very smoothly every time. I am not going to lie, it takes a fair amount of time to backup, restore the iOS and then restore from the backup, but it could very well resolve the issue.
On the other hand, it may not help at all. Restoring the software is a standard troubleshooting measure And that is why it is recommended when other suggestions aren't working. But before you restore, there are a couple of other things that you could try,
Reset all settings. Settings>General>Reset>Reset all Settings. You will not lose any data when you do this, but it does take some time to enter all of the device settings again, so be aware of that.
Another thing to try is to erase the device and start over. This is different than restoring to factory settings. Reads rhis for more information.
iOS: How to back up your data and set up your device as a new device

Unable to load the data into Cube Using DTP in the quality system

Hi,
I am unable to load the data from PSA to Cube using DTP in the quality system for the first time
I am getting the error like" Data package processing terminated" and "Source TRCS 2LIS_17_NOTIF is not allowed".
Please suggest .
Thanks,
Satyaprasad

Hi,
Some Infoobjects are missing while collecting the transport.
I collected those objects and transported ,now its working fine.
Many Thanks to all
Regards,
Satyaprasad

Date problem while loading the data

Hi Guys,
When we are extraction the data from the DataSource 0CRM_SALES_ACT_1, it is giving an error for 0calday.
If the date is greater than 2012, it is giving an error. i.e., it is taking date upto 31.12.2012. If the date is greater than that date is giving an error as "date is later than factory calendar definition".
In that case we are modifying the date in the PSA and make date less than 2013 and loading the data.
Even we have done Transfer Global setting at the source system and we checked the factory calendar in SCAL tcode it is setup to 2098.
Can you please advice how to solve the problem when we are loading the date which is greater than 31.12.2012.
Thanks in advance
Jagan

Hi Jagan,
In the info package selections tab.
for 0CALDAY field give to value as 31.12.9999 and try loading you will get all the records
Regards,
Venkatesh

Problems with loading JSON data

Hi,
I have been following Simon Widjaja(EDGEDOCKS) YouTube lesson for loading external JSON data. But i'm not able to at least log the data to console.
I get this error: "avascript error in event handler! Event Type = element"
content.json is in the home folder. Data in it is very simple:
"title": "TITLE 1",
"description": "DESCRIPTION 1"
"title": "TITLE 2",
"description": "DESCRIPTION 2"
And here's the code in edgeActions.js:
(function($, Edge, compId){
var Composition = Edge.Composition, Symbol = Edge.Symbol; // aliases for commonly used Edge classes
   //Edge symbol: 'stage'
   (function(symbolName) {
         Symbol.bindElementAction(compId, symbolName, "document", "compositionReady", function(sym, e) {
         // loading external json data
         $.ajax({
         type: "GET",
         cache: false,
         url: "content.json",
         datatype: "json",
         success: function(data){ console.log("data: ", data); },
         error: function() { console.log("something went wrong"); }
      //Edge binding end
   })("stage");
   //Edge symbol end:'stage'
})(window.jQuery || AdobeEdge.$, AdobeEdge, "EDGE-11125477");
I have tried $getJSON also as mentioned in the youtube video.
Please note: I don't get "something went wrong" also logged.
I'm using the free trial version. Is this is a limitation in the free trial?

Well, same issue as here: Loading external data using ajax
The jQuery file is missing, so $.ajax() or $.getJSON() cannot run.
You have to add the jQuery file as indicated below:
See: http://jquery.com/download/
Note: Without loading the jQuery file, you can use these functions: Adobe Edge Animate CC JavaScript API

Problem While loading Master data from R/3

Hi All,
When i am trying to load masters data from R/3 datasources to BW Info objects in Info provider menu data is coming to PSA but going to dta targets. the data is matching with the data in R/ 3 but
Missing message: Request received
Missing message: Number of sent records
Missing message: Selection completed
Data Package 1 : arrived in BW ; Processing : Selected number does not agree with transferred n
Info IDoc 1 : sent, not arrived ; IDoc ready for dispatch (ALE service)
and error message says ERROR 4 in the update.
Can you please help me in this regard . Its Urgent.

Hi,
Check for pending IDOCS in BD87 or SM58 and execute them.
In RSMO, select the particular load you want to monitor.
In the menu bar, Environment >>> Transact. RFC >>> Select whichever is required, BW or Source System.
In the next screen you can select the Execute button and the IDOCS will be displayed.
Refer this Tcodes for IDOC status.
WE02 Display IDoc
WE05 IDoc Lists
WE06 Active IDoc monitoring
WE07 IDoc statistics
WE08 Status File Interface
WE09 Search for IDoc in Database
WE10 Search for IDoc in Archive
WE23 Verification of IDoc processing
IDOC
www.erpgenie.com/sapgenie/docs/ale_whitepaper.doc
Check Note 561880 - Requests hang because IDocs are not processed.
OR
Transact RFC error
tRFC Error - status running Yellow for long time (Transact RFC will be enabled in Status tab in RSMO).
Step 1: Goto Details, Status get the IDoc number,and go to BD87 in R/3,place the cursor in the RED IDoc entroes in tRFC
queue thats under outbound processing and click on display the IDOC which is on the menu bar.
Step 2: In the next screen click on Display tRFC calls (will take you to SM58 particular TRFC call)
place the cursor on the particular Transaction ID and go to EDIT in the menu bar --> press 'Execute LUW'
(Display tRFC calls (will take you to SM58 particular TRFC call) ---> select the TrasnID ---> EDIT ---> Execute LUW)
Rather than going to SM58 and executing LUW directly it is safer to go through BD87 giving the IDOC name as it will take you
to the particular TRFC request for that Idoc.
Thanks,
JituK

Problem while loading Master data load

Hi,
i am loading master data for 0PROJECT. for attributes and text we do have delta.
for text after load added records will be 0 eventhough few records there and they are transferred records. i checked in RSA3 it has records.
can any body tell me the reason for this?
Thanks,
Vijaya

for full load only no of added records are 0 where transferred are 26.
i checked in master data table and all these records already present... may be becoz of that reason if i do full load and delta ...added is 0 only.
am i right in this? plz let me know.
Thanks,
Vijaya

Problem with getting current date and time using oracle.jbo.domain.Date

I`d like to get current date and time using oracle.jbo.domain.Date method getCurrentDate(), but it always return current date and 12:00:00. I also need to get the current time.

I think you should use java.sql.Timestamp domain.
(And set database type to TIME or DATETIME.)
Jan

Calling SQL Loader from Forms 4.5 using HOST command in Win2000

One of my forms calls SQL Loader 7.3 using HOST command to load a csv file onto the database(Oracle 7.3) under Windows 2000 platform.
Only after sql loader finishes its operation the control should come to my form i.e. synchronous execution.
As of now its running asynchronously.
Is there any way to make it synchronous. If Not any other work arounds?
Environment Details
Forms [32 Bit] Version 4.5.10.6.0 (Production)
Windows 2000 Operating System
Oracle7 Release 7.3.2.3.2

Forms6i running on W2000, Rdbms 8.1.7
in Forms I added a button TEST,
Trigger when-button-pressed : host('test.bat') ;
in directory .......\frm I added file test.bat :
REM ===============
cd /d C:\........\ldr
pause
sqlldr parfile=test.par
pause
type test.log
pause
exit
REM ================
now, pressing TEST button opens DOS window, telling me what's going on, running sqlldr, finally going back to forms
Are you using NO_PROMPT or NO_SCREEN option of HOST command ?
Had a look at Forms 4.5 manuals, there is no mentioning of (a)synchronously operation in connection with HOST command.

Problem in loading large data to SDE using Shp2sde command

Similar Messages

Maybe you are looking for