How to upload above20000 records csv files into oracle table,Oracle APEX3.2

Can any one help me how to CSV upload more than 20,000 records using APEX 3.2 upload process.i am using regular upload process using BOLB file
SELECT blob_content,id,filename into v_blob_data,v_file_id,v_file_name
FROM apex_application_files
WHERE last_updated = (select max(last_updated)
from apex_application_files WHERE UPDATED_BY = :APP_USER)
AND id = (select max(id) from apex_application_files where updated_by = :APP_USER);
I tried to upload but my page getting time out. my application best working up to 1000 records. after that its getting timed out.Each record is storing 2 secornds in the oracle table.So 1000 records it taking 7 minuts after that APEX upload webpage getting timed out
please help me with source how to speed upload csv file process or help another best with with source example.
Thanks,
Sant.
Edited by: 994152 on Mar 15, 2013 5:38 AM

See this posting:
Internet Explorer Cannot Display
There, I provided a couple of links on this particular issue. You need to change the timeout on your application server.
Denes Kubicek
http://deneskubicek.blogspot.com/
http://www.apress.com/9781430235125
http://apex.oracle.com/pls/apex/f?p=31517:1
http://www.amazon.de/Oracle-APEX-XE-Praxis/dp/3826655494
-------------------------------------------------------------------

Similar Messages

How to import data from CSV file into a table by using oracle forms

Hi,
I have a CSV file and i want to insert in oracle database in a table by using a button in oracle forms.
the user can select CSV file by using open dialog .
can any one help me to find method to make import and select file from the client machine ?
thx.

1. create table blob
CREATE TABLE IB_LOVE
DOC          BLOB,
CONTRACT_NO VARCHAR2(20 BYTE)                NOT NULL
)2. use the code below to insert:
       INSERT INTO ordmgmt.ib_love
                   (contract_no, doc
            VALUES (:control.contract_no_input, NULL
       lb$result :=
         webutil_file_transfer.client_to_db (:b2.file_name, v_file_blob_name, v_col_blob_name,
                                             'CONTRACT_NO = ' || :control.contract_no_input);
       :SYSTEM.message_level := 25;
       COMMIT;
       :SYSTEM.message_level := 0;3. use the code below to download
     if :control.CONTRACT_NO_INPUT is not null then
          vboolean :=   webutil_file_transfer.DB_To_Client_With_Progress(
                           vfilename, --filename
                          'IB_LOVE', ---table of Blob item
                          'DOC', --Blob column name
                          'CONTRACT_NO = ' || :CONTROL.CONTRACT_NO_INPUT, ---where clause to retrieve the record
                          'Downloading from Database', --Progress Bar title
                          'Wait to Complete'); --Progress bar subtitle client_host('cmd /c start '||vfilename);
          client_host('cmd /c start '||vfilename);
     else
          errmsg('Please choose contract no');
     end if;4. use the code below to open file dialog
x:= WEBUTIL_FILE.FILE_OPEN_DIALOG ( 'c:\', '*.gif', '|*.gif|*.gif|', 'My Open Window' ) ;
:b2.FILE_NAME:=X;

Getting Issue while uploading CSV file into internal table

Hi,
CSV file Data format as below
     a             b               c              d           e               f
2.01E14     29-Sep-08     13:44:19     2.01E14     SELL     T+1
actual values of column   A is 201000000000000
                 and columen D is 201000000035690
I am uploading above said CSV file into internal table using
the below coding:
TYPES: BEGIN OF TY_INTERN.
        INCLUDE STRUCTURE KCDE_CELLS.
TYPES: END OF TY_INTERN.
CALL FUNCTION 'KCD_CSV_FILE_TO_INTERN_CONVERT'
    EXPORTING
      I_FILENAME      = P_FILE
      I_SEPARATOR     = ','
    TABLES
      E_INTERN        = T_INTERN
    EXCEPTIONS
      UPLOAD_CSV      = 1
      UPLOAD_FILETYPE = 2
      OTHERS          = 3.
IF SY-SUBRC <> 0.
    MESSAGE ID SY-MSGID TYPE SY-MSGTY NUMBER SY-MSGNO
            WITH SY-MSGV1 SY-MSGV2 SY-MSGV3 SY-MSGV4.
ENDIF.
am getting all columns data into internal table,
getting problem is columan A & D. am getting values into internal table for both; 2.01E+14. How to get actual values without modifying the csv file format.
waiting for your reply...
thanks & regards,
abhi

Hi Saurabh,
Thanks for your reply.
even i can't double click on those columns.
b'se the program needs be executed in background there can lot of csv file in one folder. No manual interaction on those csv files.
regards,
abhi

Question about reading csv file into internal table

Some one (thanks those nice guys!) in this forum have suggested me to use FM KCD_CSV_FILE_TO_INTERN_CONVERT to read csv file into internal table. However, it can be used to read a local file only.
I would like to ask how can I read a CSV file into internal table from files in application server?
I can't simply use SPLIT as there may be comma in the content. e.g.
"abc","aaa,ab",10,"bbc"
My expected output:
abc
aaa,ab
10
bbb
Thanks again for your help.

Hi Gundam,
Try this code. I have made a custom parser to read the details in the record and split them accordingly. I have also tested them with your provided test cases and it work fine.
OPEN DATASET dsn FOR input IN TEXT MODE ENCODING DEFAULT.
DO.
READ DATASET dsn INTO record.
PERFORM parser USING record.
ENDDO.
*DATA str(32) VALUE '"abc",10,"aaa,ab","bbc"'.
*DATA str(32) VALUE '"abc","aaa,ab",10,"bbc"'.
*DATA str(32) VALUE '"a,bc","aaaab",10,"bbc"'.
*DATA str(32) VALUE '"abc","aaa,ab",10,"b,bc"'.
*DATA str(32) VALUE '"abc","aaaab",10,"bbc"'.
FORM parser USING str.
DATA field(12).
DATA field1(12).
DATA field2(12).
DATA field3(12).
DATA field4(12).
DATA cnt TYPE i.
DATA len TYPE i.
DATA temp TYPE i.
DATA start TYPE i.
DATA quote TYPE i.
DATA rec_cnt TYPE i.
len = strlen( str ).
cnt = 0.
temp = 0.
rec_cnt = 0.
DO.
* Start at the beginning
IF start EQ 0.
    "string just ENDED start new one.
    start = 1.
    quote = 0.
    CLEAR field.
ENDIF.
IF str+cnt(1) EQ '"'. "Check for qoutes
    "CHECK IF quotes is already set
    IF quote = 1.
      "Already quotes set
      "Start new field
      start = 0.
      quote = 0.
      CONCATENATE field '"' INTO field.
      IF field IS NOT INITIAL.
        rec_cnt = rec_cnt + 1.
        CONDENSE field.
        IF rec_cnt EQ 1.
          field1 = field.
        ELSEIF rec_cnt EQ 2.
          field2 = field.
        ELSEIF rec_cnt EQ 3.
          field3 = field.
        ELSEIF rec_cnt EQ 4.
          field4 = field.
        ENDIF.
      ENDIF.
*      WRITE field.
    ELSE.
      "This is the start of quotes
      quote = 1.
    ENDIF.
ENDIF.
IF str+cnt(1) EQ ','. "Check end of field
    IF quote EQ 0. "This is not inside quote end of field
      start = 0.
      quote = 0.
      CONDENSE field.
*      WRITE field.
      IF field IS NOT INITIAL.
        rec_cnt = rec_cnt + 1.
        IF rec_cnt EQ 1.
          field1 = field.
        ELSEIF rec_cnt EQ 2.
          field2 = field.
        ELSEIF rec_cnt EQ 3.
          field3 = field.
        ELSEIF rec_cnt EQ 4.
          field4 = field.
        ENDIF.
      ENDIF.
    ENDIF.
ENDIF.
CONCATENATE field str+cnt(1) INTO field.
cnt = cnt + 1.
IF cnt GE len.
    EXIT.
ENDIF.
ENDDO.
WRITE: field1, field2, field3, field4.
ENDFORM.
Regards,
Wenceslaus.

How to create power shell script to upload all termset csv files into the SharePoint2013 local taxonomy ?

Hi Everyone,
I want to create a powershell script file
1) Check a directory and upload all termset csv files into the SharePoint local taxonomy.
2) Input paramaters - directory that containss termset csv files, Local Termstore to import to,
3) Prior to updating get a backup of the existing termstore (for rollback/recovery purposes)
4) Parameters should be passed in via XML file.
Please let me know how to do it.
Regards,
Srinivas

Hi,
Please check this link
http://termsetimporter.codeplex.com/
Please remember to click 'Mark as Answer' on the answer if it helps you

Uploading CSV file into internal table

Hi,
I want to upload a CSV file into internal table.The flat file is having values as below:
'AAAAA','2003-10-11 07:52:37','167','Argentina',NULL,NULL,NULL,NULL,NULL,'MX1',NULL,NULL,'AAAA BBBB',NULL,NULL,NULL,'1',NULL,NULL,'AR ',NULL,NULL,NULL,'ARGENT','M1V','MX1',NULL,NULL,'F','F','F','F','F',NULL,'1',NULL,'MX','MMI ',NULL
'jklhg','2004-06-25 08:01:57','456','hjllajsdk','MANAGUA ',NULL,NULL,'265-5139','266-5136 al 38','MX1',NULL,NULL,'hjgkid GRÖBER','sdfsdf dfs asdfsdf 380 ad ased,','200 as ads, sfd sfd abajao y 50 m al sdf',NULL,'1',NULL,NULL,'NI ',NULL,NULL,NULL,'sdfdfg','M1V','dds',NULL,NULL,
Here I can not even split at ',' because some of the values are having value like NULL and some have values with comma too,
The delimiter is a quote and the separator is a comma here.
Can anyone help on this?
Thanks.
Edited by: Ginger on Jun 29, 2009 9:08 AM

As long as there can be a comma in a text literal you are right that the spilt command doesn't help. However there is one possibility how to attack this under one assumption:
- A comma outside a text delimiter is always considered a separator
- A comma inside a text delimiter is always considered a comma as part of the text
You have to read you file line by line and then travel along the line string character by character and setting a flag or counter for the text delimiters:
e.g.
"Text","Text1, Text2",NULL,NULL,"Text"
String Index 1: EQ " => lv_delimiter = 'X'
String Index 2: EQ T => text literal (because lv_delimiter = 'X')
String Index 3: EQ e => text literal (because lv_delimiter = 'X')
String Index 4: EQ x => text literal (because lv_delimiter = 'X')
String Index 5: EQ t => text literal (because lv_delimiter = 'X')
String Index 6: EQ " => lv_delimiter = ' ' (because it was 'X' before)
String Index 7: EQ , => This is a separator because lv_delimiter = ' '
String Index 8: EQ " => lv_delimiter = 'X' (because it was ' ' before)
String Index 9: EQ T => text literal (because lv_delimiter = 'X')
String Index 10: EQ e => text literal (because lv_delimiter = 'X')
String Index 11: EQ x => text literal (because lv_delimiter = 'X')
String Index 12: EQ t => text literal (because lv_delimiter = 'X')
String Index 13: EQ 1 => text literal (because lv_delimiter = 'X')
String Index 14: EQ , => text literal (because lv_delimiter = 'X')
String Index 15: EQ T => text literal (because lv_delimiter = 'X')
Whenever you hit a 'real' separator (lv_delimiter = ' ') you pass the value of the string before that up to the previous separator into the next structure field.
This is not an easy way to do it, but if you might have commas in your text literal and NULL values I gues it is probably the only way to go.
Hope that helps,
Michael

How to upload and download a files into AL11 directory in ABAP

Hi,
How to upload and download a files into AL11 directory in ABAP
thanks
Moderator message: please search for available information/documentation.
Edited by: Thomas Zloch on Mar 21, 2011 9:18 AM

You should try one of these forums for an answer to your question:
http://swforum.sun.com/jive/forum.jspa?forumID=116
http://community.java.net/netbeans
http://linux.java.net

How to upload a SAP request files into our PRD ?

dear all ,
there is a software installed on windows 2008, this software will connect to our SAP production server to collect some data.
there is a problem within the connection, the software vendors send some files with *.E6D Extension and ask us to install on SAP production server to resolve the problem.
the files are
K900086.E6D
K900096.E6D
K900102.e6d
R900086.E6D
R900096.E6D
R900102.e6d
i think these files are are change requests copied from the transport directory from a SAP DEV server
my question is how to upload or install these file into SAP PRD server?
thanks in advance
Mahmoud Younis

Hi,
Firstly copy the cofiles and datafiles of above mentioned requests into /usr/sap/trans .../cofiles and /data of PRD.
Then Login to PRD in default client
go to tcode STMS
select the production server
From Menu , Extras -> Other request , add each of these transport request into the import queue of PRD.
Then run the import of these requests as per the sequence specified.
Hope this answers your query.
Regards,
Deepak Kori

Loading data from .csv file into existing table

Hi,
I have taken a look at several threads which talk about loading data from .csv file into existing /new table. Also checked out Vikas's application regarding the same. I am trying to explain my requirement with an example.
I have a .csv file and I want the data to be loaded into an existing table. The timesheet table columns are -
timesheet_entry_id,time_worked,timesheet_date,project_key .
The csv columns are :
project,utilization,project_key,timesheet_category,employee,timesheet_date , hours_worked etc.
What I needed to know is that before the csv data is loaded into the timesheet table is there any way of validating the project key ( which is the primary key of the projects table) with the projects table . I need to perform similar validations with other columns like customer_id from customers table. Basically the loading should be done after validating if the data exists in the parent table. Has anyone done this kind of loading through the APEX utility-data load.Or is there another method of accomplishing the same.
Does Vikas's application do what the utility does ( i am assuming that the code being from 2005 the utility was not incorporated in APEX at that time). Any helpful advise is greatly appreciated.
Thanks,
Anjali

Hi Anjali,
Take a look at these threads which might outline different ways to do it -
File Browse, File Upload
Loading CSV file using external table
Loading a CSV file into a table
you can create hidden items in the page to validate previous records before insert data.
Hope this helps,
M Tajuddin
http://tajuddin.whitepagesbd.com

How do I call two csv files into ews?

I have to call two csv files into a script with ews:
Param([string]$calInputFile = "C:\Algemene agenda\Data docenten.txt" )
Param([string]$calMailboxFile ="C:\Algemene agenda\Alle docenten.txt"
# Load all Entries
$calagenda = Import-Csv $calInputFile
$calMailbox = Import-Csv $callMailboxfile
This do not work.
How can I do this???

OH!! Why didn't I see this before? s-: You are having problems with the Param definition, but it appears you are having troubles pulling the data into the script. You can only have a single Param definition for a script. Try
the following instead:
Param(
[string]$calInputFile
= "C:\Algemene agenda\Data docenten.txt",
[string]$calMailboxFile
="C:\Algemene agenda\Alle docenten.txt"
## Load all Entries
$calagenda = Import-Csv $calInputFile
$calMailbox = Import-Csv $callMailboxfile
To define multiple parameters, you have your Param definition (with its parentheses) and all parameters are defined inside it, separated by commas.

How can i read local excel file into internal table in webdynpro for abap a

Could someone tell me how How can i read local excel file into an internal table in webdynpro for abap application.
thank u for your reply

Deep,
File manuplations...............................
1. At the presentation level:
->GUI_UPLOAD
->GUI_DOWNLOAD
->CL_GUI_FRONTEND
2. At the application server level:
->OPEN DATASET : open a file in the application server for reading or writing.
->READ DATASET : used to read from a file on the application server that has been opened for reading
-> TRANSFER DATASET : writing data to a file.
-> CLOSE DATASET : closes the file
-> DELETE DATASET : delete file
If file is on the local PC,use the function module GUI_UPLOAD to upload it into an internal table by passing the given parameters......
call function 'GUI_UPLOAD'
exporting
filename = p_file
filetype = 'ASC'
has_field_separator = '#'
tables
data_tab = t_data
p_file : excel file path.
t_data : internal table
<b>reward points if useful.</b>
regards,
Vinod Samuel.

Uploading the contents of file into custom table

Hi ,
I have a req where in i want to put the contents of the file into the Z table . I have taken a file upload UI element and in that i have taken 4 attributes as file name f, file type ,file size and file contents and binded this file contents to the data property of the UI element. Now with out explicitly defining the fields i want to put all this content of file into the Z table created for any file created or if i could put the whole text file into that table so that any one could see that file even though its not saved in the desktop for that user.
Can any one help me out?

Yes i am converting it inot the lstring using the same FM which you have given. I have to store the total file but the only doubt is like if its a input field how could i save a file form. Can you please check the code i want to save the total file into the table.
DATA lo_nd_upload TYPE REF TO if_wd_context_node.
    DATA lo_el_upload TYPE REF TO if_wd_context_element.
    data i_data TYPE STANDARD TABLE OF string.
    DATA ls_upload TYPE wd_this->Element_upload.
    data lv_field type string.
    data lt_file type TABLE OF ZFILE_UPLOAD.
    data ls_file LIKE LINE OF lt_file.
    data l_xstring type xstring.
   data fields TYPE string_table.
data l_String type string.
navigate from <CONTEXT> to <UPLOAD> via lead selection
    lo_nd_upload = wd_context->get_child_node( name = wd_this->wdctx_upload ).
@TODO handle non existant child
IF lo_nd_upload IS INITIAL.
ENDIF.
get element via lead selection
    lo_el_upload = lo_nd_upload->get_element( ).
@TODO handle not set lead selection
    IF lo_el_upload IS INITIAL.
    ENDIF.
get all declared attributes
    lo_el_upload->get_static_attributes(
      IMPORTING
        static_attributes = ls_upload ).
   DATA lv_file_contents TYPE wd_this->Element_upload-file_contents.
navigate from <CONTEXT> to <UPLOAD> via lead selection
@TODO handle non existant child
IF lo_nd_upload IS INITIAL.
ENDIF.
get element via lead selection
   lo_el_upload = lo_nd_upload->get_element( ).
alternative access via index
lo_el_upload = lo_nd_upload->get_element( index = 1 ).
@TODO handle not set lead selection
   IF lo_el_upload IS INITIAL.
   ENDIF.
get single attribute
   lo_el_upload->get_attribute(
     EXPORTING
       name = 'FILE_CONTENTS'
     IMPORTING
       value = l_xstring ).
for text file conversion we have to FM
CALL FUNCTION 'HR_KR_XSTRING_TO_STRING'
EXPORTING
FROM_CODEPAGE       = '8500'
    IN_XSTRING          = l_xstring
OUT_LEN             =
IMPORTING
   OUT_STRING          = l_string.
SPLIT l_string AT cl_abap_char_utilities=>newline INTO TABLE i_data.
LOOP AT i_data INTO l_string.
    SPLIT l_string AT cl_abap_char_utilities=>horizontal_tab INTO TABLE fields.
    read TABLE fields into lv_field index 1.
endloop.
ls_upload will contain all the file details
ls_file-file_size = xstrlen( ls_upload-file_contents ) * lv_float .
ls_file-file_name = ls_upload-file_name.
ls_file-file_type = ls_upload-file_type.
ls_file-file_contents = ls_upload-file_contents.
insert ZFILE_UPLOAD FROM ls_file.
thanks

Upload data from flat file into internal table

Hi friends,
I want to upload the data from a flat file into internal table , but the problem is that all the columns in that flat file are seperated by "|" character instead of tabs.
Plz help me out.........

HEllo,
DO like this.
CALL FUNCTION 'GUI_UPLOAD'
EXPORTING
FILENAME = LV_FILENAME
FILETYPE = 'ASC'
HAS_FIELD_SEPARATOR = 'X' " Check here
* HEADER_LENGTH = '1'
* READ_BY_LINE = 'X'
* DAT_MODE = ' '
* CODEPAGE = ' '
* IGNORE_CERR = ABAP_TRUE
* REPLACEMENT = '#'
* CHECK_BOM = ' '
* IMPORTING
* FILELENGTH =
* HEADER =
TABLES
DATA_TAB = IT_COJRNL
EXCEPTIONS
FILE_OPEN_ERROR = 1
FILE_READ_ERROR = 2
NO_BATCH = 3
GUI_REFUSE_FILETRANSFER = 4
INVALID_TYPE = 5
NO_AUTHORITY = 6
UNKNOWN_ERROR = 7
BAD_DATA_FORMAT = 8
HEADER_NOT_ALLOWED = 9
SEPARATOR_NOT_ALLOWED = 10
HEADER_TOO_LONG = 11
UNKNOWN_DP_ERROR = 12
ACCESS_DENIED = 13
DP_OUT_OF_MEMORY = 14
DISK_FULL = 15
DP_TIMEOUT = 16
OTHERS = 17
IF SY-SUBRC <> 0.
MESSAGE ID SY-MSGID TYPE SY-MSGTY NUMBER SY-MSGNO
WITH SY-MSGV1 SY-MSGV2 SY-MSGV3 SY-MSGV4.
ENDIF.
VAsanth

How to read the CSV Files into Database Table

Hi
Friends i have a Table called tblstudent this has the following fields Student ID, StudentName ,Class,Father_Name, Mother_Name.
Now i have a CSV File with 1500 records with all These Fields. Now in my Program there is a need for me to read all these Records into this Table tblstudent.
Note: I have got already 2000 records in the Table tblstudent now i would like to read all these CSV File records into the Table tblstudent.
Please give me some examples to do this
Thank your for your service
Cheers
Jofin

1) Read the CSV file line by line using BufferedReader.
2) Convert each line (record) to a List and add it to a parent List. If you know the columns before, you might use a List of DTO's.
3) Finally save the two-dimensional List or the List of DTO's into the datatable using plain JDBC or any kind of ORM (Hibernate and so on).
This article contains some useful code snippets to parse a CSV: http://balusc.xs4all.nl/srv/dev-jep-csv.html

JCS: how to load users with csv file into Identity Console

In my Java Cloud Service: When I go to Identity Console I have a function "Load users" under "Manage Users".
How should this CSV file look like?
How can I add roles to the users?
I loaded yesterday a file and I still get the message "Maximum number of simultaneous uploads per identity domain exceeded. No more uploads will be accepted at this time. Select UTF-8 encoded CSV file you wish to upload. Maximum file size is 256 KB."
When will this file be process? Can I cancel this process? How do I get notified about a result?
kind regards
Robert

see http://docs.oracle.com/cloud/131/trial_paid_subscriptions/CSGSG/cloud-manage-user-accounts.htm#BCFDAIJA Adding a Batch of User Accounts
file has to have a header:
First Name,Last Name,Email,User Login

How to upload above20000 records csv files into oracle table,Oracle APEX3.2

Similar Messages

Maybe you are looking for