How to tokenize a column with variable length string

I have a question regarding tokenizing string in a column I have table like
id list
1 i love dogs
2 i like cats and dogs
and so on
it should be converted to
id list
1 i
1 love
1 dogs
2 i
2 like
2 cates
2 and
2 dogs
How do I tokenize this? I tried using this code inside cursor and procedure
SELECT id, regexp_substr(str, '[^ ]+', 1, level) TOKEN from test CONNECT by level <= length(regexp_replace (str, '[^ ]+')) + 1;
but this is very slow when called from java. Is there any other alternative?
Thanks

69edfef1-01fd-49c3-b83d-ece76195d26c wrote:
I have a question regarding tokenizing string in a column I have table like
id list
1 i love dogs
2 i like cats and dogs
and so on
it should be converted to
id list
1 i
1 love
1 dogs
2 i
2 like
2 cates
2 and
2 dogs
How do I tokenize this? I tried using this code inside cursor and procedure
SELECT id, regexp_substr(str, '[^ ]+', 1, level) TOKEN from test CONNECT by level <= length(regexp_replace (str, '[^ ]+')) + 1;
but this is very slow when called from java. Is there any other alternative?
Thanks
The reason yours is slow is because you don't have sufficient connect by conditions to restrict the iterations properly...
e.g. What you are doing...
SQL> ed
Wrote file afiedt.buf
1 with t as (select 1 as id, 'i love dogs' list from dual union all
2             select 2, 'i like cats and dogs' from dual union all
3             select 3,'precipitevolissimevolmente' from dual)
4 --
5 --
6 --
7 SELECT id
8        ,regexp_substr(list, '[^ ]+', 1, level) TOKEN
9 from t
10* CONNECT by level <= length(regexp_replace (list, '[^ ]+')) + 1
SQL> /
        ID TOKEN
         1 i
         1 love
         1 dogs
         2 and
         2 dogs
         2 cats
         2 and
         2 dogs
         2 like
         1 dogs
         2 and
         2 dogs
         2 cats
         2 and
         2 dogs
         2 i
         1 love
         1 dogs
         2 and
         2 dogs
         2 cats
         2 and
         2 dogs
         2 like
         1 dogs
         2 and
         2 dogs
         2 cats
         2 and
         2 dogs
         3 precipitevolissimevolmente
         1 love
         1 dogs
         2 and
         2 dogs
         2 cats
         2 and
         2 dogs
         2 like
         1 dogs
         2 and
         2 dogs
         2 cats
         2 and
         2 dogs
45 rows selected.
And with additional connect by criteria...
SQL> ed
Wrote file afiedt.buf
1 with t as (select 1 as id, 'i love dogs' list from dual union all
2             select 2, 'i like cats and dogs' from dual union all
3             select 3,'precipitevolissimevolmente' from dual)
4 --
5 --
6 --
7 SELECT id
8        ,regexp_substr(list, '[^ ]+', 1, level) TOKEN
9 from t
10 CONNECT by level <= length(regexp_replace (list, '[^ ]+')) + 1
11         and id = prior id
12*        and prior sys_guid() is not null
SQL> /
        ID TOKEN
         1 i
         1 love
         1 dogs
         2 i
         2 like
         2 cats
         2 and
         2 dogs
         3 precipitevolissimevolmente
9 rows selected.

Similar Messages

How to browse MQ queue with variable length messages?

I am trying to browse messages on an Websphere MQ queue using PL/SQL and Oracle Gateway for Websphere MQ (both 11g2)
However, the (XML) messages are of variable length: they can be less than 1k or over 100k.
I found that the pgm.mqget procedure is overloaded, so if the message is longer than 32k, you need to use the PGM.MQGET_BUFFER, and else you use the RAW variable.
However, in order to know the length, you’ll need to browse the message first, to get the message length.
If I try to get a message using the buffer variable, and the messsage is 32k or shorter, the program aborts with
ORA-28511: lost RPC connection to heterogeneous remote agent using SID= +<db_link_name>+
ORA-06512: at "SYS.PGM", line 390
ORA-06512: at "SYS.PGM", line 849
If I try to browse a message longer than 32k using the RAW variable, the ‘mqget’ statement just hangs. I tried with and without setting the MQGMO option ‘mqgmo_acccept_truncated_message’.
Any advise on how to solve this issue?
Arnold

I am trying to browse messages on an Websphere MQ queue using PL/SQL and Oracle Gateway for Websphere MQ (both 11g2)
However, the (XML) messages are of variable length: they can be less than 1k or over 100k.
I found that the pgm.mqget procedure is overloaded, so if the message is longer than 32k, you need to use the PGM.MQGET_BUFFER, and else you use the RAW variable.
However, in order to know the length, you’ll need to browse the message first, to get the message length.
If I try to get a message using the buffer variable, and the messsage is 32k or shorter, the program aborts with
ORA-28511: lost RPC connection to heterogeneous remote agent using SID= +<db_link_name>+
ORA-06512: at "SYS.PGM", line 390
ORA-06512: at "SYS.PGM", line 849
If I try to browse a message longer than 32k using the RAW variable, the ‘mqget’ statement just hangs. I tried with and without setting the MQGMO option ‘mqgmo_acccept_truncated_message’.
Any advise on how to solve this issue?
Arnold

How to retrieve 'long' column with 32K length in Java stored procedure

For some reasons, we are not using CLOB, BLOB, or BFILE to store large objects and I have to live with LONG. So I wrote a Java stored procedure to insert, select and manipulate a LONG column by retrieving the LONG into a java.lang.String class (which happens to be the Java class mapped to the LONG SQL datatype). It all works fine as long as the length of the value being retrieved is less than the magic figure of 32767 bytes (which is the restriction on LONG and VARCHAR2 datatype in PL/SQL as well). So looks like Oracle's implementation of the JVM limits String values to a max of 32767 bytes. Suggestions on how to overcome this limitation (other classes that you suggest or do I have to move to files)?
Thanks,
Jeet
null

the jvm has nothing to do with it ...
this is a pol/sql limitation on parameters in stored procedures.
and java stored procedures require a clal spec that makes the j-s-p look like a pl/qsl stored proc.

How to insert a table with variable rows in smart form

Hi all,
How to insert a table with variable rows in smart form?
Any help would be appreciated.
Regards,
Mahesh.

Hi,
Right click the mouse->create->table
If you want 5 columns, you need to declare 5 cells in one line type of the table
Click on Table -> Details, then do the following
Line Type 1 2 3 4 5
L1 2mm 3mm etc
Here specify the width of the columns as many as you want..
then in the header/main area of the table, click create Table Line, Rowtype is L1, automatically 5 cells will come,In each cell create a text element, display the variable to be printed there.

How to make text columns with adobe muse

Hi,How to make text columns with adobe muse (like InDesign)?

Multiple columns can be acheived with CSS - http://www.w3schools.com/css/css3_multiple_columns.asp
div
-moz-column-count:3; /* Firefox */
-webkit-column-count:3; /* Safari and Chrome */
column-count:3;
I'm surprised that Muse does not support text columns yet, but perhaps the custom CSS can be added in style tags on page properties. Haven't tried it, but don't see why it wouldn't work.

How can i register column with in the query

hi all
how can i register column with in the query?

Thanks.
In my business one, the column width was registed.
But I don't know how can I do it.
So I try to save the query again after change column width.
Then the query was opend with changed column width.
Is it right function?
Is there any way to register the column width?
It's very troublesome to change column width every time.
seiichi

How to run execute immdiate with variables

Hi friends,
How to run execute immdiate with variables in v_stmt below?
I dont know how to declare the value of i here.
Set serveroutput on;
DECLARE
   i        VARCHAR (20);
   v_stmt   VARCHAR2 (100);
   CURSOR c
   IS
      SELECT sqlid FROM temp1;
BEGIN
   OPEN c;
   LOOP
      FETCH c INTO i;
      EXIT WHEN c%NOTFOUND;
      DBMS_OUTPUT.put_line (i);
      v_stmt := 'select * from table(dbms_xplan.display_cursor('&i',null))'
      execute immediate v_stmt;
   END LOOP;
   CLOSE c;
END;
/Regds,
Kunwar.

You first need to use a bind variable (named ':v' in SQL statement in my example):
set serveroutput on;
DECLARE
   i        VARCHAR (20);
   v_stmt   VARCHAR2 (100);
   CURSOR c
   IS
       -- modified for a quick test
      SELECT sql_id FROM v$sql where child_number > 2;
BEGIN
   OPEN c;
   LOOP
      FETCH c INTO i;
      EXIT WHEN c%NOTFOUND;
      DBMS_OUTPUT.put_line (i);
      v_stmt := 'select * from table(dbms_xplan.display_cursor(:v,null))';
      execute immediate v_stmt using i;
   END LOOP;
   CLOSE c;
END;
/However because your SELECT statement returns several rows you need to adapt your code to process all rows returned (as already suggested in first reply to your message).
Instead of using PL/SQL, I recommend to generate a SQL file using only SQL and then to run the generated SQL file.
For example:
spool edx.sql
set serveroutput on
declare
v_stmt varchar2(100);
v_q char(1):='''';
begin
dbms_output.put_line('spool edx.log');
for s in (select sql_id from v$sql where child_number >2)
loop
dbms_output.put_line('select * from table(dbms_xplan.display_cursor(' || v_q || s.sql_id || v_q || ',null));');
end loop;
dbms_output.put_line('exit');
end;
spool ofThis generates a SQL file similar to :
spool edx.log
select * from table(dbms_xplan.display_cursor('5rygsj4dbw6jt',null));
select * from table(dbms_xplan.display_cursor('5rygsj4dbw6jt',null));
select * from table(dbms_xplan.display_cursor('5rygsj4dbw6jt',null));
select * from table(dbms_xplan.display_cursor('fsbqktj5vw6n9',null));
select * from table(dbms_xplan.display_cursor('6q42j0018w7t8',null));
select * from table(dbms_xplan.display_cursor('a5mmhrrnpwjsc',null));
select * from table(dbms_xplan.display_cursor('3c1kubcdjnppq',null));
select * from table(dbms_xplan.display_cursor('3c1kubcdjnppq',null));
select * from table(dbms_xplan.display_cursor('9gkq7rruycsjp',null));
select * from table(dbms_xplan.display_cursor('f0wj261bm8snd',null));
select * from table(dbms_xplan.display_cursor('ab3swhv5g138y',null));
select * from table(dbms_xplan.display_cursor('6vgvyh4xw9c5g',null));
select * from table(dbms_xplan.display_cursor('ak5crjygnpk60',null));
select * from table(dbms_xplan.display_cursor('9p6bq1v54k13j',null));
select * from table(dbms_xplan.display_cursor('19x1189chq3xd',null));
select * from table(dbms_xplan.display_cursor('7sx5p1ug5ag12',null));
select * from table(dbms_xplan.display_cursor('730vdzhng6m6g',null));
select * from table(dbms_xplan.display_cursor('730vdzhng6m6g',null));
select * from table(dbms_xplan.display_cursor('0v3dvmc22qnam',null));
select * from table(dbms_xplan.display_cursor('0v3dvmc22qnam',null));
select * from table(dbms_xplan.display_cursor('a1zv6wju3ftgv',null));
select * from table(dbms_xplan.display_cursor('7ng34ruy5awxq',null));
select * from table(dbms_xplan.display_cursor('7ng34ruy5awxq',null));
select * from table(dbms_xplan.display_cursor('b2gnxm5z6r51n',null));
select * from table(dbms_xplan.display_cursor('b2gnxm5z6r51n',null));
select * from table(dbms_xplan.display_cursor('g4gp07gt2z920',null));
select * from table(dbms_xplan.display_cursor('1gu8t96d0bdmu',null));
select * from table(dbms_xplan.display_cursor('g00cj285jmgsw',null));
select * from table(dbms_xplan.display_cursor('g00cj285jmgsw',null));
select * from table(dbms_xplan.display_cursor('g00cj285jmgsw',null));
select * from table(dbms_xplan.display_cursor('bn4b3vjw2mj3u',null));
select * from table(dbms_xplan.display_cursor('38243c4tqrkxm',null));
select * from table(dbms_xplan.display_cursor('2abjfnvy5rkyg',null));
select * from table(dbms_xplan.display_cursor('350f5yrnnmshs',null));
select * from table(dbms_xplan.display_cursor('350f5yrnnmshs',null));
select * from table(dbms_xplan.display_cursor('3s1yukp05bzg6',null));
select * from table(dbms_xplan.display_cursor('3s1yukp05bzg6',null));
select * from table(dbms_xplan.display_cursor('1tgukkrqj3zhw',null));
exit
PL/SQL procedure successfully completed.Edited by: P. Forstmann on 20 mars 2013 19:06
Edited by: P. Forstmann on 20 mars 2013 19:33

How to deal with variable length data struct in C/JNI

I have another JNI related question. How do you handle variable length
data structures in Java and pointer to a pointer?
Basically, I have a backend in C which has records but we don't know
how many. The API looks like
typedef struct rec_list_s {
int rec_list_cnt;
rec_list_data_t rec_list_data[1];
} rec_list_t;
int rec_list_show(void handle, rec_list_t *list_ptr);
/* Code snippet for rec_list_show */
int rec_list_show(void handle, rec_list_t *list_ptr)
rec_list_t *ptr;
sz = sizeof (rec_list_t) +
((record_count - 1) * sizeof (rec_list_data_t));
ptr = malloc(sz);
/* fill the data */
*list_ptr = ptr;
return (0);
So I need to wrap rec_list_show() in JNI call so I can have Java call
it. How do i pass a pointer to a pointer from Java? I tried in the
native C code for JNI to return the pointer to pointer as a result
and store in a member in the Java class rec_list_t and then I pass
that to JNI call for rec_list_show. The C backend code was fine
since it got the pointer to pointer but Java become unhappy when
the object it was referencing changed memory location (I suspect
the garbage collection becomes unhappy).
So what would be a good way to deal with this kind of code?
Thanks,
Sunay
Edited by: st9 on Aug 30, 2010 5:47 PM

I did not imply that you don't know C but you are implying that I don't understand C. Perhaps
google Sunay Tripathi and click I am feeling lucky so that we don't get into teaching C
discussions :) On the other hand, I am definitely looking for someone to teach me Java
otherwise I wouldn't be asking.
Anyway, let me explain again. The sample function rec_list_show() runs on the backend. It
is a different process with a different VM space. It of course knows the size of the array
and what to fill in. As a caller to that API (which is a separate process), I don't know
what that size is but I need to get the size and corresponding data in one shot because
the backend locks the table when its providing me the info to make sure its synchronous.
Now I (the Java process) needs to get that count and data in one shot. Since the C library
underneath me (wrapped around my JNI interface) has private IPC mechanism to copy
the contiguous memory from the backend into my memory space, all I need is to provide
a pointer to a pointer which gets filled in by backend and is available to my process. So
my equivalent C frontend just passes a pointer to a pointer and casts the return value in
rec_list_t. The rec_list_cnt tells it how many members it got. The first member is part of
the struct itself but then following members are right after.
Another way to help you understand this is with this code snippet from front end C program
rec_list_t     *ptr, *save_ptr;
rec_list_data_t *data_ptr;
int          cnt;
save_ptr = ptr = malloc(sizeof(rec_list_t));
rec_list_show(handle, &ptr);
assert(save_ptr != ptr);
cnt = ptr->rec_list_cnt;
for (i = 0; i < cnt; i++) {
     data_ptr = &ptr->rec_list_data;
Notice the assert(). Also notice the for loop. How do I expect to walk more that one
member when rec_list_data is a fixed size array of one member?typedef struct rec_list_s {
     int               rec_list_cnt;
     rec_list_data_t          rec_list_data[1];
} rec_list_t;
Anyway, I do understand that Java will not allow me to get a reference to a long and
how Java memory management works. But the JNI native implementation is C
and I was wondering if people have managed to do some tricks there between C
and Java.

How to use datamerge with variable lengths of text?

Hello,
I'm looking for a way to automaticly format brochures from a database . I allready found out that datamerge lets you do this quite easily. But I encounter a problem when I use large amounts of text.
How I see it, the only solution is to reserve enough space for the larges text in order to make all of the text appear in the document. But this leaves large open spaces and even blank pages in my document when I deal with less text.
Is there a way to make the document adapt to the amount of text? So that Indesign creates more space for large amounts of text and erases blank pages when there is less text?
Maybe Datamerge isn't the right solution for my problem, I'm open to suggestions.
Thanks in advance!
Iris

I'm just finishing up a directory that I build with data merge and I have the problem of variable length business descriptions, as well as some have extra mailing addresses or websites. My solution is to do it in several steps with multiple files. I do a normal merge first (and I use a single record per page for this, but only bcause that allows me to create some alphabetical lists of business names and owners's names that I can key to a listing number), then I stitch together the individual stories into a single text thread that I copy/paste into place in the final document. If you have a lot of frames, Rorohiko.com has a nifty text stitch script that will help.
One tip that helps with this method is to be sure you have a paragraph break at the end of each story so stiching the frames together maintains your paragraphs.

How to handle flat file with variable delimiters in the file sender adapter

Hi friends,
I have some flat files in the ftp server and hope to poll them into XI, but before processing in XI, I hope to do some content conversion in the file sender adapter, according to the general solution, I just need to specify the field names, field seperator, end seperator, etc. But the questions is:
The fileds in the test data may have different amount of delimiters (,), for example:
ORD01,,,Z4XS,6100001746,,,,,2,1
OBJ01,,,,,,,,,,4,3
Some fileds only have 1 ',' as the delimiter, but some of them have multiple ','.
How can I handle it in the content conversion?
Regards,
Bean

Hi Bing,
Plz do refer the following blogs u will get an idea:
File content conversion Blogs
/people/venkat.donela/blog/2005/03/02/introduction-to-simplefile-xi-filescenario-and-complete-walk-through-for-starterspart1
/people/venkat.donela/blog/2005/03/03/introduction-to-simple-file-xi-filescenario-and-complete-walk-through-for-starterspart2
/people/arpit.seth/blog/2005/06/02/file-receiver-with-content-conversion
/people/anish.abraham2/blog/2005/06/08/content-conversion-patternrandom-content-in-input-file
/people/shabarish.vijayakumar/blog/2005/08/17/nab-the-tab-file-adapter
/people/venkat.donela/blog/2005/03/02/introduction-to-simplefile-xi-filescenario-and-complete-walk-through-for-starterspart1
/people/venkat.donela/blog/2005/03/03/introduction-to-simple-file-xi-filescenario-and-complete-walk-through-for-starterspart2
/people/venkat.donela/blog/2005/06/08/how-to-send-a-flat-file-with-various-field-lengths-and-variable-substructures-to-xi-30
/people/anish.abraham2/blog/2005/06/08/content-conversion-patternrandom-content-in-input-file
/people/shabarish.vijayakumar/blog/2005/08/17/nab-the-tab-file-adapter
/people/jeyakumar.muthu2/blog/2005/11/29/file-content-conversion-for-unequal-number-of-columns
/people/shabarish.vijayakumar/blog/2006/02/27/content-conversion-the-key-field-problem
/people/michal.krawczyk2/blog/2004/12/15/how-to-send-a-flat-file-with-fixed-lengths-to-xi-30-using-a-central-file-adapter
/people/arpit.seth/blog/2005/06/02/file-receiver-with-content-conversion
http://help.sap.com/saphelp_nw04/helpdata/en/d2/bab440c97f3716e10000000a155106/content.htm
Regards,
Vinod.

How to save blob data (variable length string) in a customized table?

Dear Friends
I have written a very simple program to update table with 2 fields which
looks as follows.
========================================================
Table name ZTESTBLOBDATA
Field         Key          Init    Data Element   Data Type Length
ID          Checked                 ZID                 NUMC        2
BLOB                                   ZBLOB           STRING       0
=========================================================
FOllowing is the sample program that I have written (Transaction SE38).
=========================================================
REPORT ZTESTBLOBPROG
TABLES: ZTESTBLOBDATA
data : itab like ZTESTBLOPDATA occurs 1 with header line.
select * from ztestblobdata into table itab.
ztestblobdata-id =   sy-dbcnt +1.
ztestblobdata -blob = 'abcdefghijklmnopqrstuvwxyz.'.
insert ztestblobdata.
=========================================================
When I try to save and activate the program, I get the following
error message
'ztestblopdata' must be a flat structure. You cannot use internal
tables, strings, references, or structures as components.
==========================================================
Using the data type STRING is a must since it is a variable length
data which varies from few characters to few gig.
How can go around this problem.
Any feedback will be highly appreciated.
PS. I have checked old postings on SDN, spoken to my ABAP contacts and also couple of instructors from SAP when I took XI courses but didn't get a satisfactory answers.
Edited by: Ram Prasad on Oct 15, 2008 12:28 PM

Thanks a lot for the response.
The string that we are getting is from another application via netweaver XI integration and is being sent as a string which has to be saved in an SAP table. I am not sure if IDOC option will suit our needs, but will definitely read more about it.
If there is any other suggestion of feedback I would appreciate it a lot.;
Tks
Ram

ALV column with variable number of decimals to be displayed

Hi,
I've an ALV where I need to display a numeric column with a variable number of decimal row-by-row, from 0 (no decimals) to 4.
I've declared the numeric field as TYPE P DECIMALS 4.
I've tried with DECMLFIELD in ALV catalog, and this works for 1 to n decimals, but when I leave the field indicated in DECMLFIELD equal to 0, ALV shows the default number of decimals of the field (4 in that case).
Any help will be very appreciated.
Thanks.
Jordi

No, I didn't try EDIT_MASK.
How should I use it to format output to display decimals or not depending on the row?
I have 2 kinds of values, all stored in a TYPE P DECIMALS 4: Those that really are an integer (decimals should not be displayed for that ones) and the values that really have 4 decimals (which should be displayed with decimals in ALV).
Example:
13,0000 should be displayed as 13
0,4567 should be displayed as 0,4567
With EDIT_MASK could I do that?
Thank you very much.

How to use wild card with variable in powershell

HI
i am trying to use wild card with variable but getting an error message, "You cannot call a method on a null-valued expression."
$src = 'C:\Temp'
$TabletzipPath = $src + "tab*.zip"
i would like to copy the tablet zip file which is placed in in $src to be copied in $TabletzipPath.
i am using tab* because this file name changes continuously. so if i give a fix name for example tablet1.zip than it works fine.

Not sure if the wildcard will work without seeing how you're using the variable.
That said, I can say that it looks like you're missing the backslash between the $src path and the wildcard filename. As-is the above code assigns a value to $TabletzipPath of "C:\temptab*.zip" instead of what you are likely expecting ("C:\temp\tab*.zip")
Jason Warren
@jaspnwarren
jasonwarren.ca
habaneroconsulting.com/Insights

How to update a column with default in a tabular form.

We have a tabular form that has a submit button that does a multi row update. We would like to update a column with a defaut like APP_USER = updated user when the row is updated. Is this possible and how?

used lovs and conditions.

How to create a array with variables dimensions?

I try to create a array like that:
Object[][] data;
data = new Object[] [];
But that's doesn't work!
Apparently I must specify the dimension of my array
So I have done like that :
Object[][] data;
data = new Object[3] [3];
And that work!
But the problem is when I need to add extra elements to my array.
If I write :
data[4][1] = "123";
I have the error message :
java.lang.ArrayIndexOutOfBoundsException
So, how can I defined a array with variables dimensions OR how can I add a dimension to a array?

if you have:
Object[][] data;
data = new Object[3] [3];you end yo getting ArrayIndexOutOfBoundException if you try to point to some other Indexes. You can increase the size by doing new:
Object[][] data;
data = new Object[4] [3];and then copy the old Arrays to this one... this is heavy.
Other thing to consider then is using some other datastructure, such as Vector, which grows along you add elements to it.
P_trg

How to tokenize a column with variable length string

Similar Messages

Maybe you are looking for