USING DATA LOADING WIZARD

All,
I writing a data load process to copy&paste or upload files all is good. but now i want to bypass the step for column mapping (run it in the background/ move that copy to step1) so a user doesn't see it while loading the data by default the stages are: (
Data Load Source
Data / Table Mapping
Data Validation
Data Load Results
so i want to run the 2nd step in the background (or if i can move that function and combine with step 1)...any help?
apex 4.2
thanks.

Maybe consider page branches on the relevant page, or the plugin
- Process Type Plugin - EXCEL2COLLECTIONS

Similar Messages

4.2.3/.4 Data load wizard - slow when loading large files

Hi,
I am using the data load wizard to load csv files into an existing table. It works fine with small files up to a few thousand rows. When loading 20k rows or more the loading process becomes very slow. The table has a single numeric column for primary key.
The primary key is declared at "shared components" -> logic -> "data load tables" and is recognized as "pk(number)" with "case sensitve" set to "No".
While loading data, these configuration leads to the execution of the following query for each row:
select 1 from "KLAUS"."PD_IF_CSV_ROW" where upper("PK") = upper(:uk_1)
which can be found in the v$sql view while loading.
It makes the loading process slow, because of the upper function no index can be used.
It seems that the setting of "case sensitive" is not evaluated.
Dropping the numeric index for the primary key and using a function based index does not help.
Explain plan shows an implicit "to_char" conversion:
UPPER(TO_CHAR(PK)=UPPER(:UK_1)
This is missing in the query but maybe it is necessary for the function based index to work.
Please provide a solution or workaround for the data load wizard to work with large files in an acceptable amount of time.
Best regards
Klaus

Nevertheless, a bulk loading process is what I really like to have as part of the wizard.
If all of the CSV files are identical:
use the Excel2Collection plugin ( - Process Type Plugin - EXCEL2COLLECTIONS )
create a VIEW on the collection (makes it easier elsewhere)
create a procedure (in a Package) to bulk process it.
The most important thing is to have, somewhere in the Package (ie your code that is not part of APEX), information that clearly states which columns in the Collection map to which columns in the table, view, and the variables (APEX_APPLICATION.g_fxx()) used for Tabular Forms.
MK

Data Loading Wizard loses Column Mapping

I created pages of APEX page type "Data Loading." They are being used to populate Staging tables and worked terrific in my existing environment. However; I migrated the DB using export and imported it into a new environment. Similarly, I exported my APEX Application and imported it into the new environment. It appears that the second page of Data Loading Wizard has lost the mapping of which table it is loading into. On every column in the second page the only option for the column name is "Do Not Load". What do I need to move over, so that my Data Loading Wizard pages remembers the column names for the table they were mapped to in the old environment?

Hi David,
You didn't mention what version of APEX you are using. Their was an issue in 4.1 in the export file where the owner wasn't being updated:
wwv_flow_api.create_load_table(
p_id =>3570143708960669327+ wwv_flow_api.g_id_offset,
p_flow_id => wwv_flow.g_flow_id,
p_name =>'Load Employees',
p_owner =>'PAUL',
p_table_name =>'EMP',
p_unique_column_1 =>'EMPNO',
p_is_uk1_case_sensitive =>'N',
p_unique_column_2 =>'',
p_is_uk2_case_sensitive =>'N',
p_unique_column_3 =>'',
p_is_uk3_case_sensitive =>'N',
p_wizard_page_ids =>'',
p_comments =>'');Try modifying the p_owner =>'PAUL' line in your export file and change it to the name of the schema your importing it into.
Thanks
Paul

Modify the Data Load wizard to remove the check for unique columns

Hi,
I'm trying to make a Data Loading Wizard into my application, which basically works nice except for one thing:
I want to remove the check for unique columns, and insert ALL data which the users wants to upload.
(Like the Data load utility under development).
The reason is, that the data I want to upload is an export from my bank statements (in XLS / CSV format)
And these exports don't have any primary key.
Using the Apex wizard created Data Upload pages, I will loose data in case I had two identical payments in a day.
Is there a way to do this, while keeping the pages created by the wizard to make Data Loading pages?
apex 4.2.1

I would suggest to load the data into a view and process the records into the real table(s) with instead-of-triggers. When you add a "1=2" where clause to the view, there never is any data and everything will be loaded.
Otherwise you have to have a "real" PK value, like a timestamp or a statement_nr+line_nr.

Data Loading Wizard in Apex 4.1.1

I am having an issue utilizing the out of the box APEX Data loading wizard.
My data (separated by \t) has double quotes (") in them and no variation of "Enclosed by" or "Separated by" item settings is allowing the "Parse Uploaded Data" process to correctly parse the information.
Am I missing something obvious ? Has anyone got it to work with data that does contain double quotes?

Hi Usul,
I am able to parse data with double quotes and separated by a tab (\t). can you double check if your file is tab separated and contains double quotes ? or would you share the file with me so that i can check what is going on ?
Regards,
Patrick

Data Load Wizard not Inserting/Updating all rows

Hello,
I am able to run through the whole Data Load Wizard without any problems. It reports that it successfully inserted/updated all the rows, but when I look in the table, I find a few rows that were not updated correctly. Of the entries I've identified that don't get inserted/updated properly, I've noticed they are the same rows that I was having issues with earlier. The issue was a number format error, which I solved by providing an explicit number format.
Is it possible that the false inserts/updates might still be tied to the number format, or are there other reasons why the data load is failing on only some rows.
Thanks,
Brian
Edited by: 881159 on Mar 14, 2012 5:05 PM

Hi Brian,
I am not aware of the situation where you get false results. However, there were some issues with number/date formats that sometime were not properly parsed, and this has been fixed in 4.1.1 patch. would your case be different from the one described in bug 13656397, I will be happy to get more details so that I can take a look at what is going on.
Regards,
Patrick

How to automate the data load process using data load file & task Scheduler

Hi,
I am doing Automated Process to load the data in Hyperion Planning application with the help of data_Load.bat file & Task Scheduler.
I have created Data_Load.bat file but rest of the process i am unable complete.
So could you help me , how to automate the data load process using Data_load.bat file & task Scheduler or what are the rest of the file is require to achieve this.
Thanks

To follow up on your question are you using the maxl scripts for the dataload?
If so I have seen and issue within the batch (ex: load_data.bat) that if you do not have the full maxl script path with a batch when running it through event task scheduler the task will work but the log and/ or error file will not be created. Meaning the batch claims it ran from the task scheduler although it didn't do what you needed it to.
If you are using maxl use this as the batch
"essmsh C:\data\DataLoad.mxl" Or you can also use the full path for the maxl either way works. The only reason I would think that the maxl may then not work is if you do not have the batch updated to call on all the maxl PATH changes or if you need to update your environment variables to correct the essmsh command to work in a command prompt.

Using data loading softwares better than SM35 as batch input

Hi All,
Can anyone tell me what are the pros and cons of using SM35 batch input in SAP as compared with commercial data loading software like win shuttle, data loader etc
Thanks in advance.

Our data loading software runs in the background, with each particular run set as a separate batch. It doesn't matter if this data comes from a program generated on site, or via a data feed interfaced from another system. With the transaction, SM35, I can look at each run and know immediately if any entry within that run did not post correctly, as well as those that did. I can view each transaction and get a detailed log on all that happened. If an entry failed to post, I can see exactly where within the posting process the transaction failed and why it failed. When we have a problem with a new - or recently changed, interface, SM35 is the tool I use to debug the problem fast. Another benefit of this batch input session is when a user tells me her/his interface failed. Often it didn't; someone just ran off with their interface report. In those cases, I don't have to restore & re-run anything. I just reprint the run to the relief - and gratitude, of the user.

How to update existing table using Data Load from spreadsheet option?

Hi there,
I need to update an existing table, but in Data Load application when you select csv file to upload it inserts all data by replacing existing one. How can i change this?
Let me know,
Thank you.
A.B.A.

And how do you expect your database server to access a local file in your machine ?
Is the file accessible from outside your machine say inside a webserver folder so that some DB process can poll on the file ?
Or, is your DB server in the same machine where you have the text file ?
You will have to figure out the file acess part before automating user interaction or even auto-refreshing.

Use data services wizard or not in flash builder 4 (advice)

Hi,
I have been playing and reading a lot about how to use the new data service connection wizard for data centric management in flash buidler 4.
I'm facing now some problems, first, the files it is generating is somehow complex for me, and it seems I can't add new operations just stick to the ones it uses (documentation states the operations that must be defined to make everything work (addItem,etc...)). On the other hand, I had a little php system I used in flex builder 3 to have just only one file in the server that using reflexion could serve differnt kinds of data to the data services, now, I think I can't use them because It doesn't follow "operation names". As an example, for the getItem, I pass the VO type taht will be used, etc...
Some pros/contrs:
Using wizards
1) Everything is ready to use in seconds.
2) Forms can be generated automatically.
3) Best aproach to do things (I guess, if adobe people is doint it this way it is because it is the best way to do it)
Without wizards
1) No time trying to undestand the cryptic generated files.
2) Free to use any signature to calll from the services (Not just stick to addItem, updateItem, etc... with predefined signature.
3) Less server files floating around (if you like me do some kind of reflection on the service files, to share operations for any type you need).
Well, perhaps I could be totally wrong, but it is a bit of a pain for me to get into CDM, could anyone bring some light, confirming for exampel that new operations can be added easily, etc...?
Thanks in advance,
Aron.

hi,
DCD is currently in its infancy and suffers from a lack of features you might find in more mature tools of this nature. In its current form I think its a great tool for rapid prototyping and as it matures may also be a great tool for enterprise development. I am sure as Adobe work with feedback they get from the community these wizards etc.. will get much better.
So that leaves you with the choice of staying with what you are familiar with or putting the effort into become familiar with DCD and using it to its maximum abilities then pushing it a bit further. Its now a part of the environment and its not going to disappear so its wise to at least become familiar with its useability so you don't get left behind as it does improve.
At the moment it does a lot of the minding numbing work of setting up connections preparing client side and server side scripting for basic crud operations and in many simple cases this will be enough.
You can update services with you own code and DCD will generate the client side code for you (VO's etc) you just need to guide DCD as to send and return types. In a lot of cases you can reuse the value objects generated for your extended services (for instance you have a client table that you create a filter for you just tell dcd its the same type as a select from client and when it generates your client code it knows how to type results etc.)
Experts will never be happy with wizards, the code is not as optimal as hand written code and sometimes confusing to maintain. For those getting into development of backend communication the DCD will help them immensely, and hopefully guide them to best practises when it comes to how you should structure everything.
Is it ready for large scale application ?, thats not my call to make(but it's not ready yet ), I will use DCD if I think it can do the job without to much from me otherwise the old tried and true methods will be applied. My expectation is that the DCD will become more powerful and as it does I will be ready to use it on a more frequent basis. For now I still concentrate most my efforts on the 'old way' but won't ignore and the value it can bring to the development cycle.
David

Data Load function - max number of columns?

Hello,
I was able to successfully create a page with Data Load Wizard. I've used this page wizard before with no issues, however in this particular case I want to load a spreadsheet with a lot of columns (99 to be precise). When I run the page, it uploads the spreadsheet into the proper table, but only the first 45 columns. The remaining 56 columns are Null for all rows. Also, there are 100 rows in the spreadsheet and it doesn't load them all (it loads 39).
Is there a limit to the number of columns it can handle?
Also, when I re-upload the same file, the data load results show that it Inserted 0 rows, Updated 100 rows, Failed 0 zeros. However there are still only a total of 39 rows in the table.
Thoughts?
Steve

Steve wrote:
FYI, I figured out why it wasn't loading all 100 rows. Basically I needed to set two dependent columns in the load definition instead of one; it was seeing multiple rows in the spreadsheet and assumed some were the same record based on one column. So that part is solved...
I still would like feedback on the number of columns the Data Load Wizard can handle, and if there's way to handle more than 45.The Data Load Wizard can handle a maximum of 46 columns: +{message:id=10107069}+

Data load component - add new column name alias

Apex 4.2.2.
Using the data load wizard a list of column and column name aliases had been created.
When looking at the component (shared components/Data load tables/column name aliases) it is possible to edit and delete a column alias there. Unfortunatly it does not seem possible to add a new alias. Do I overlook something, or is there a workaround for this?

Try this:
REPORT ztest LINE-SIZE 80 MESSAGE-ID 00.
DATA: name_int TYPE TABLE OF v_usr_name WITH HEADER LINE.
DATA: BEGIN OF it_bkpf OCCURS 0.
        INCLUDE STRUCTURE bkpf.
DATA:   username LIKE v_usr_name-name_text,
      END   OF it_bkpf.
SELECT * FROM bkpf INTO TABLE it_bkpf UP TO 1000 ROWS.
LOOP AT it_bkpf.
name_int-bname = it_bkpf-usnam.
APPEND name_int.
ENDLOOP.
SORT name_int BY bname.
DELETE ADJACENT DUPLICATES FROM name_int.
LOOP AT it_bkpf.
READ TABLE name_int WITH KEY
    bname = it_bkpf-usnam
    BINARY SEARCH.
IF name_int-name_text IS INITIAL.
    SELECT SINGLE name_text
      FROM v_usr_name
      INTO name_int-name_text
      WHERE bname = it_bkpf-usnam.
    MODIFY name_int index sy-tabix.
ENDIF.
it_bkpf-username = name_int-name_text.
MODIFY it_bkpf.
ENDLOOP.
Rob

VNI-2015 : / OEM Load Wizard

Hi,
I try to load data into a table using the Load Wizard in OEM(2.0.4) on an 8i 8.1.5 running in W2K. The job results with the message "VNI-2015 : authentication error ".
Is there anyone who can give me an advise for a solution or a hint on where I can find a detailed description of the error ?
Thanks in advance !
null

Hi Adam,
I've got my agent up and running!
Follow these steps and it shoud work :
1. Shutdown your agent
2. chown oracle $ORACLE_HOME/bin/dbsnmp
3. rm $ORACLE_HOME/network/admin/dbsnmp*
4. rm $ORACLE_HOME/network/log/dbsnmp*
5. rm $ORACLE_HOME/network/agent/*.q
6. rm $ORACLE_HOME/network/agent/dbsnmp.ver
7. rm $ORACLE_HOME/network/agent/services.ora
8. startup your agent
I think there is a problem with the agent- executable running as root with s-bit.
Hope this helps
Greetings from bavaria
Bernhard

Data Load - Data / Table Mapping Columns Not Showing

Hi,
Using the new 4.1 functionality I have created a data load wizard.
Everything seems to have created OK however when i run the wizard and get to the Data / Table Mapping stage (2nd page) the column names lov contains no list of values.
The table i am trying to load in is in another schema but all the grants are there so that schema can view it.
Any idea what I need to do or what I have missed so the columns can be viewed.
Thanks in advance.

Hi,
You have to log in as admin and there should be an option to add schemas, once adding it should appear in the lov.
This link should help.
Parsing Schema

Data Load Tables - Shared components

Hello All,
There is a section that is called Data Loading in Shared components in every application that says: A Data Load Table is an existing table in your schema that has been selected for use in the data loading process, to upload data. Use Data Load Tables to define tables for use in the Data Loading create page wizard.
The question is: How ca i select a table in my schema for use in the data loading process to upload data using the wizard?
There is a packaged application that is called Sample Data loading. That sample is use for specific tables right? I tried to change those tables for the ones that I want to use but I could not because I could not add the tables that I want to use....
Thank you.

Hi,
The APEX version is Application Express 4.2.3.00.07.
The application sample for data loading it created the data loading entry in shared components by default. In that part, I don't have the option to create a new one for the table that I want to load the data. I tried to modify that entry putting the table that I want, but i couldn't, because the table that it has it's not editable.
I tried to modify the Data Loading page that the application sample created but I couldn't. I can't change the source for the table that I want.
I have created a workspace at apex.oracle.com. If you want I can give you credentials to help me please, but I need your email for create the user for you. Thank you.
Bernardo

USING DATA LOADING WIZARD

Similar Messages

Maybe you are looking for