SQL-Tokenizer based on regular-expressions does not work

Question

I'm on 10gR2
Following SQL-Tokenizer converts string :str to rows using :delim as the delimiter-char (:str and :delim are parameters):
select level, regexp_replace(regexp_substr( :in_str || :in_delimiter, '(.*?)' || :in_delimiter, 1, level ), :in_delimiter, '') as token
from dual
connect by regexp_instr( :in_str || :in_delimiter, '(.*?)' || :in_delimiter, 1, level ) > 0
order by level asc ;
When using the pipe-symbol "|" as the delimiter, it doesn't work; the rows are processed, but the tokens are null. Using an other char as delimiter (e.g. ";") works fine.
:str = "123;456;A1;67X;0;-8" & :delim = ";" => works fine
:str = "123|456|A1|67X|0|-8" & :delim = "|" => does not work
I think the bug is in the regexp-parameter for the pattern, isn't it?
Why doesn't work the pipe-symbol as delimiter?
Can anybody give me a hint for using the correct regexp-pattern?
thx
Nuerni

Answer 1

select level, rtrim(regexp_substr( :in_str || :in_delimiter, '(.*?)' || :in_delimiter, 1, level ),:in_delimiter ) as token
from dual
connect by regexp_instr( :in_str || :in_delimiter, '(.*?)' || :in_delimiter, 1, level ) > 0
order by level asc ;use a rtrim instead of regexp_replace then it works...
Ravi Kumar