Data Loading Wizard in Apex 4.1.1

I am having an issue utilizing the out of the box APEX Data loading wizard.
My data (separated by \t) has double quotes (") in them and no variation of "Enclosed by" or "Separated by" item settings is allowing the "Parse Uploaded Data" process to correctly parse the information.
Am I missing something obvious ? Has anyone got it to work with data that does contain double quotes?

Hi Usul,
I am able to parse data with double quotes and separated by a tab (\t). can you double check if your file is tab separated and contains double quotes ? or would you share the file with me so that i can check what is going on ?
Regards,
Patrick

Similar Messages

4.2.3/.4 Data load wizard - slow when loading large files

Hi,
I am using the data load wizard to load csv files into an existing table. It works fine with small files up to a few thousand rows. When loading 20k rows or more the loading process becomes very slow. The table has a single numeric column for primary key.
The primary key is declared at "shared components" -> logic -> "data load tables" and is recognized as "pk(number)" with "case sensitve" set to "No".
While loading data, these configuration leads to the execution of the following query for each row:
select 1 from "KLAUS"."PD_IF_CSV_ROW" where upper("PK") = upper(:uk_1)
which can be found in the v$sql view while loading.
It makes the loading process slow, because of the upper function no index can be used.
It seems that the setting of "case sensitive" is not evaluated.
Dropping the numeric index for the primary key and using a function based index does not help.
Explain plan shows an implicit "to_char" conversion:
UPPER(TO_CHAR(PK)=UPPER(:UK_1)
This is missing in the query but maybe it is necessary for the function based index to work.
Please provide a solution or workaround for the data load wizard to work with large files in an acceptable amount of time.
Best regards
Klaus

Nevertheless, a bulk loading process is what I really like to have as part of the wizard.
If all of the CSV files are identical:
use the Excel2Collection plugin ( - Process Type Plugin - EXCEL2COLLECTIONS )
create a VIEW on the collection (makes it easier elsewhere)
create a procedure (in a Package) to bulk process it.
The most important thing is to have, somewhere in the Package (ie your code that is not part of APEX), information that clearly states which columns in the Collection map to which columns in the table, view, and the variables (APEX_APPLICATION.g_fxx()) used for Tabular Forms.
MK

Data Loading Wizard loses Column Mapping

I created pages of APEX page type "Data Loading." They are being used to populate Staging tables and worked terrific in my existing environment. However; I migrated the DB using export and imported it into a new environment. Similarly, I exported my APEX Application and imported it into the new environment. It appears that the second page of Data Loading Wizard has lost the mapping of which table it is loading into. On every column in the second page the only option for the column name is "Do Not Load". What do I need to move over, so that my Data Loading Wizard pages remembers the column names for the table they were mapped to in the old environment?

Hi David,
You didn't mention what version of APEX you are using. Their was an issue in 4.1 in the export file where the owner wasn't being updated:
wwv_flow_api.create_load_table(
p_id =>3570143708960669327+ wwv_flow_api.g_id_offset,
p_flow_id => wwv_flow.g_flow_id,
p_name =>'Load Employees',
p_owner =>'PAUL',
p_table_name =>'EMP',
p_unique_column_1 =>'EMPNO',
p_is_uk1_case_sensitive =>'N',
p_unique_column_2 =>'',
p_is_uk2_case_sensitive =>'N',
p_unique_column_3 =>'',
p_is_uk3_case_sensitive =>'N',
p_wizard_page_ids =>'',
p_comments =>'');Try modifying the p_owner =>'PAUL' line in your export file and change it to the name of the schema your importing it into.
Thanks
Paul

Modify the Data Load wizard to remove the check for unique columns

Hi,
I'm trying to make a Data Loading Wizard into my application, which basically works nice except for one thing:
I want to remove the check for unique columns, and insert ALL data which the users wants to upload.
(Like the Data load utility under development).
The reason is, that the data I want to upload is an export from my bank statements (in XLS / CSV format)
And these exports don't have any primary key.
Using the Apex wizard created Data Upload pages, I will loose data in case I had two identical payments in a day.
Is there a way to do this, while keeping the pages created by the wizard to make Data Loading pages?
apex 4.2.1

I would suggest to load the data into a view and process the records into the real table(s) with instead-of-triggers. When you add a "1=2" where clause to the view, there never is any data and everything will be loaded.
Otherwise you have to have a "real" PK value, like a timestamp or a statement_nr+line_nr.

Data Load Wizard not Inserting/Updating all rows

Hello,
I am able to run through the whole Data Load Wizard without any problems. It reports that it successfully inserted/updated all the rows, but when I look in the table, I find a few rows that were not updated correctly. Of the entries I've identified that don't get inserted/updated properly, I've noticed they are the same rows that I was having issues with earlier. The issue was a number format error, which I solved by providing an explicit number format.
Is it possible that the false inserts/updates might still be tied to the number format, or are there other reasons why the data load is failing on only some rows.
Thanks,
Brian
Edited by: 881159 on Mar 14, 2012 5:05 PM

Hi Brian,
I am not aware of the situation where you get false results. However, there were some issues with number/date formats that sometime were not properly parsed, and this has been fixed in 4.1.1 patch. would your case be different from the one described in bug 13656397, I will be happy to get more details so that I can take a look at what is going on.
Regards,
Patrick

Data load problem in Apex 3.2

Hi
Apex 3.2:
Using Utilities>Data Load/Unload I am trying to load spreadsheet data. Despite reducing the data down to the simplest possible example I keep getting all rows rejected with
ORA-00926: missing VALUES keyword
I have tried tab delimited and comma delimited. I can't find any other users hitting this problem, and I have been pleasantly surprised when I lasted used this facility many months ago on 3.1.2 when it worked like a dream.
Any thoughts?
thanks...

PROBLEM SOLVED
The schema and the workspace names were in the form:
AAAAAAAAA-AA
I found that data imports worked OK for other workspaces which happened to have simpler naming. I created a new workspace and schema (shorter and without the hyphen) and everything works OK.
I then tried the same with a new schema and tablespace both called TEST-AB and the load failed with the same error
I'm guessing that this is probably a known issue? It would be nice if Apex could reject illegal schema/tablespace names!
I am gratefull for help offered from other replies and hope this observation will help others...

USING DATA LOADING WIZARD

All,
I writing a data load process to copy&paste or upload files all is good. but now i want to bypass the step for column mapping (run it in the background/ move that copy to step1) so a user doesn't see it while loading the data by default the stages are: (
Data Load Source
Data / Table Mapping
Data Validation
Data Load Results
so i want to run the 2nd step in the background (or if i can move that function and combine with step 1)...any help?
apex 4.2
thanks.

Maybe consider page branches on the relevant page, or the plugin
- Process Type Plugin - EXCEL2COLLECTIONS

Data Loading issue in APEX

Hi Everybody..
I'm new to Oracle APEX and i'm facing the issues loading the data into the table. My issue is the text data is getting loaded with double quotes.
Please suggests.
Thanks,
Suresh

Hi,
assuming you're loading data via the APEX gui via Home>SQL Workshop>Utilities>Data Workshop>Load Data
Otherwise provide more info like APEX version used, how/where you are uploading data etc.
If you put your data in a file and select ""Upload file (comma separated or tab delimited" then on the next screen you can the field "Optionally Enclosed By" to double quotes (")
This should strip the double quotes from the data during import.
Regards
Bas

Data load component - add new column name alias

Apex 4.2.2.
Using the data load wizard a list of column and column name aliases had been created.
When looking at the component (shared components/Data load tables/column name aliases) it is possible to edit and delete a column alias there. Unfortunatly it does not seem possible to add a new alias. Do I overlook something, or is there a workaround for this?

Try this:
REPORT ztest LINE-SIZE 80 MESSAGE-ID 00.
DATA: name_int TYPE TABLE OF v_usr_name WITH HEADER LINE.
DATA: BEGIN OF it_bkpf OCCURS 0.
        INCLUDE STRUCTURE bkpf.
DATA:   username LIKE v_usr_name-name_text,
      END   OF it_bkpf.
SELECT * FROM bkpf INTO TABLE it_bkpf UP TO 1000 ROWS.
LOOP AT it_bkpf.
name_int-bname = it_bkpf-usnam.
APPEND name_int.
ENDLOOP.
SORT name_int BY bname.
DELETE ADJACENT DUPLICATES FROM name_int.
LOOP AT it_bkpf.
READ TABLE name_int WITH KEY
    bname = it_bkpf-usnam
    BINARY SEARCH.
IF name_int-name_text IS INITIAL.
    SELECT SINGLE name_text
      FROM v_usr_name
      INTO name_int-name_text
      WHERE bname = it_bkpf-usnam.
    MODIFY name_int index sy-tabix.
ENDIF.
it_bkpf-username = name_int-name_text.
MODIFY it_bkpf.
ENDLOOP.
Rob

Data Load function - max number of columns?

Hello,
I was able to successfully create a page with Data Load Wizard. I've used this page wizard before with no issues, however in this particular case I want to load a spreadsheet with a lot of columns (99 to be precise). When I run the page, it uploads the spreadsheet into the proper table, but only the first 45 columns. The remaining 56 columns are Null for all rows. Also, there are 100 rows in the spreadsheet and it doesn't load them all (it loads 39).
Is there a limit to the number of columns it can handle?
Also, when I re-upload the same file, the data load results show that it Inserted 0 rows, Updated 100 rows, Failed 0 zeros. However there are still only a total of 39 rows in the table.
Thoughts?
Steve

Steve wrote:
FYI, I figured out why it wasn't loading all 100 rows. Basically I needed to set two dependent columns in the load definition instead of one; it was seeing multiple rows in the spreadsheet and assumed some were the same record based on one column. So that part is solved...
I still would like feedback on the number of columns the Data Load Wizard can handle, and if there's way to handle more than 45.The Data Load Wizard can handle a maximum of 46 columns: +{message:id=10107069}+

Data Load - Data / Table Mapping Columns Not Showing

Hi,
Using the new 4.1 functionality I have created a data load wizard.
Everything seems to have created OK however when i run the wizard and get to the Data / Table Mapping stage (2nd page) the column names lov contains no list of values.
The table i am trying to load in is in another schema but all the grants are there so that schema can view it.
Any idea what I need to do or what I have missed so the columns can be viewed.
Thanks in advance.

Hi,
You have to log in as admin and there should be an option to add schemas, once adding it should appear in the lov.
This link should help.
Parsing Schema

Column number limitation in apex 4.1 data loader?

Hi all!
Is there a limitation of column numbers in the APEX 4.1 data loading page?
My DB Object has 59 columns and they are all available for example in the unique colum drop boxes of my data load table definition.
On page two of the wizard created data load pages 'data/table mapping' only 45 columns are shown. These columns are correctly inserted into my table. The last 14 columns are ignored.
So does anyone know if there is a limitation and can it be extended?
Thanks for any answer and regards
Kai

No, I do not have a solution for it.
Splitting the file into fewer columns each, with the primary key repeated and then stitching the tables up post upload might be easier than using other routes.
And then there are always the good old SQL Loader and External Tables. But integrating these into Apex is not easy as Apex runs on server and the file is typically on the local HDD of client.
Regards,

Unable to load CSV data using APEX Data Load using Firefox/Safari on a MAC

I have APEX installed on a Windows XP machine connected to an 11g database on the same Windows XP machine.
While on the windows XP, using IE 7, I am able to successfully load a CSV spreadsheet of data using the APEX Data Load utility.
However, if I switch to my MacBook Pro running OS X leopard, then login into same APEX machine using Firefox 2 or 3 or Safari 3, then try to upload CSV data, it fails on the "Table Properties" step when it asks you for the name of the new table and then asks you to set table properties, the table properties just never appear (they do appear in IE 7 on Windows XP) and if you try to hit the NEXT button, you get error message: "1 error has occurred. At least one column must be specified to include in new table." and of course, you can't specify the any of the columns because there is nothing under SET TABLE PROPERTIES in the interface.
I also tried to load data with Firefox 2, Firefox 3 (beta), and Safari 3.1, but get same failed result on all three. If I return to the Windows XP machine and use IE 7.0, Data Load works just fine. I work in an ALL MAC environment, it was difficult to get a windows machine into my workplace, and all my end users will be using MACs. There is no current version of IE for the MAC, so I have to use Firefox or Safari.
Is there some option in Firefox or Safari that I can turn on so this Data Load feature will work on the MAC?
Thanks for your help. Any assistance appreciated.
Tony

I managed to get this to work by saving the CSV file as Windows CSV (not DOS CSV), which allowed the CSV data to be read by Oracle running on Windows XP. I think the problem had to do with different character sets being used for CSV on MAC versus CSV on Windows. Maybe if I had created my windows XP Oracle database with Unicode as the default character set, I never would have experienced this problem.

Data load uses wrong character set, where to correct? APEX bug/omission?

Hi,
I created a set of Data Load pages in my application, so the users can upload a CSV file.
But unlike the Load spreadsheet data (under SQL Workshop\Utilities\Data Workshop), where you can set the 'File Character Set', I didn't see where to set the Character set for Data Load pages in my application.
Now there is a character set mismatch, "m³/h" and "°C" become "m�/h" and "�C"
Where to set?
Seems like an APEX bug or at least omission, IMHO the Data Load page should ask for the character set, as clients with different character sets could be uploading CSV.
Apex 4.1 (testing on the apex.oracle.com website)

Hello JP,
Please give us some more details about your database version and its character set, and the character set of the CSV file.
>> …But unlike the Load spreadsheet data (under SQL Workshop\Utilities\Data Workshop), where you can set the 'File Character Set', I didn't see where to set the Character set for Data Load pages in my application.
It seems that you are right. I was not able to find any reference to the (expected/default) character set of the uploaded file in the current APEX documentation.
>> If it's an APEX omission, where could I report that?
Usually, an entry on this forum is enough as some of the development team members are frequent participants. Just to be sure, I’ll draw the attention of one of them to the thread.
Regards,
Arie.
&diams; Please remember to mark appropriate posts as correct/helpful. For the long run, it will benefit us all.
&diams; Author of Oracle Application Express 3.2 – The Essentials and More

Is it possible to upload few column in table through Apex Data Loading

Hi All,
I have to do upload into the table through a csv file . The table's primary key i have to load the rest through user's uploaded file. Is it possible to do the data loading to the table only to required columns and fill the other columns from backend. Or is there any other way to do this?

Hi,
Your query is not really clear.
>
Is it possible to do the data loading to the table only to required columns and fill the other columns from backend. Or is there any other way to do this?
>
How do you plan to "link" the rows from these 2 sets of data in the "backend"? There has to be a way to have a relation between them.
Regards,

Data Loading Wizard in Apex 4.1.1

Similar Messages

Maybe you are looking for