Eliminating Hex Characters in Data

Is there a way to search for specific hex characters in the database?
I have a phone number field of type varchar2, which has some hex characters I need to remove.
When I do query I see the following record.
     PHONE     DUMP(PHONE)
1     +001(718)380 4160     Typ=1 Len=18: 43,48,48,49,40,55,49,56,41,51,56,48,32,52,49,54,48,14
2     +001(225)292 2812     Typ=1 Len=18: 43,48,48,49,40,50,50,53,41,50,57,50,32,50,56,49,50,14
The hex character isn't visible in this post, but it is very much there. What's the mechanism to find this specific character? I want to find characters like '0x0E' and '0x01'
I hope I am being clear in my request. The objective is to ensure that none of these affect the XML transformation mechanism.

abhijit74 wrote:
Is there a way to search for specific hex characters in the database?
I have a phone number field of type varchar2, which has some hex characters I need to remove.
When I do query I see the following record.
     PHONE     DUMP(PHONE)
1     +001(718)380 4160     Typ=1 Len=18: 43,48,48,49,40,55,49,56,41,51,56,48,32,52,49,54,48,14
2     +001(225)292 2812     Typ=1 Len=18: 43,48,48,49,40,50,50,53,41,50,57,50,32,50,56,49,50,14
The hex character isn't visible in this post, but it is very much there. What's the mechanism to find this specific character? I want to find characters like '0x0E' and '0x01'
I hope I am being clear in my request. The objective is to ensure that none of these affect the XML transformation mechanism.TRANSLATE() function will do what you desire
you can display the non-printable characters using ASCIISTR() function

Similar Messages

I want to take a series of hex characters in a string control and produce an HDLC string indicator for example if the data string control is 3F27 then the HDLC string indicator is 7E003F2700B57E

I want to take a series of hex characters in a string control and produce an HDLC string indicator for example if the data string control is 3F27 then the HDLC string indicator is 7E003F2700B57E

"thanks for your help "
Does that mean you figured it out already?
If not, see this thread for some HDLC related code.
http://forums.ni.com/ni/board/message?board.id=170&message.id=146859&query.id=3388#M146859
Ben
Ben Rayner
I am currently active on.. MainStream Preppers
Rayner's Ridge is under construction

Handling Invalid(Hex) Characters Code for Unicode BI 7.0

Hi All,
I went through the beautiful weblog given by Eugene.. https://www.sdn.sap.com/irj/sdn/weblogs?blog=/pub/wlg/4059. [original link is broken] [original link is broken] [original link is broken] [original link is broken] In the comments section of the weblog there is a code given by Dirk. I tried to use the code in my transformation logic and here how it looks.. I am using BI 7.0 and it is unicode system..
============================================================
DATA: l_d_length like sy-index,
l_d_char type c,
l_d_index type sy-index.
l_d_length = strlen( result ).
RESULT = SOURCE_FIELDS-POO_TAG.
DO l_d_length times.
l_d_index = sy-index - 1.
l_d_char = result+l_d_index(1).
CALL FUNCTION 'RSKC_CHAVL_OF_IOBJ_CHECK'
IMPORTING
I_CHAVL = l_d_char
I_IOBJNM = 'ZPOTSTFL'
*" I_S_COB_PRO =
*" I_T_COB_PRO_CMP =
EXCEPTIONS
CHAVL_NOT_ALLOWED = 1.
IF SY-SUBRC <> 0.
result+l_d_index(1) = ' '.
ENDIF.
ENDDO.
===========================================================
I am using this to load from PSA to DSO, the info-object name is ZPOTSTFL(Length 3, No master, No text) and source field name is POO_TAG, since in the source the field is a free form text field and it has some hex characters ...we need to keep the free form (like $, lowercase letters, ###. etc..) but we need to eliminate the hex characters with space as it is affecting our load.
I tried this code and it gives me syntax error. In the blog Pedro has suggested to declare some 30 char string and assign that string to info-object name... I don't know that much ABAP can somebody help me with the code??
Regards,
Nikhil

Hello Dilip
Out of three two of them are definitley possible. i.e
1) CU&UC
2) Upgrade first and then do Unicode Conversion ( 2 different downtimes)
third option is possible with R3 but with BW you need to consult the master guide. ( i am not sure).
you need to decide one of them based on your hardware sizing, database size, Downtime possible.
I would suggest Make a copy of production server. and perform the upgrade and then perform unicode conversion. this whole activity will give you exact timing you need. and possible errors you will face during upgrade and unicode conversion.
i hope this helps.
Thanks
Mona

Search Box Error: LockFailedException Illegal hex characters

When I enter any data into the JDeveloper Search Box (top right hand side of the IDE) the IDE throws up an error and wants to exit telling me that the system is unstable.
This is a new install of Oracle JDeveloper 11g Release 1 11.1.1.2.0, everything worked fine in the previous version of JDeveloper I was using.
I've tried restarting JDev and rebooting my PC, but the problem persists. It seems to be a problem with projects converted from the previous JDev version as well as for new projects.
The Details of the error message are:
19/11/2009 2:54:27 PM oracle.ideimpl.searchbar.index.IndexProvider searchProject
SEVERE: Failed to search project AdminConsole.jpr
oracle.ide.index.LockFailedException: java.lang.IllegalArgumentException: URLDecoder: Illegal hex characters in escape (%) pattern - For input string: ".j"
     at oracle.ideimpl.index.IndexRoot.lock(IndexRoot.java:319)
     at oracle.ideimpl.index.IndexImpl.lock(IndexImpl.java:161)
     at oracle.ideimpl.searchbar.index.IndexProvider.searchProject(IndexProvider.java:272)
     at oracle.ideimpl.searchbar.index.IndexProvider.search(IndexProvider.java:178)
     at oracle.ideimpl.searchbar.BaseController$SearchTask.run(BaseController.java:213)
     at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
     at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
     at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
     at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.IllegalArgumentException: URLDecoder: Illegal hex characters in escape (%) pattern - For input string: ".j"
     at java.net.URLDecoder.decode(URLDecoder.java:173)
     at java.net.URLDecoder.decode(URLDecoder.java:83)
     at oracle.ide.util.PatternFilter.matchesImpl(PatternFilter.java:285)
     at oracle.ide.util.PatternFilter.matches(PatternFilter.java:138)
     at oracle.ide.util.PatternFiltersOptimizer$VanillaEvaluator.matches(PatternFiltersOptimizer.java:118)
     at oracle.ide.util.PatternFiltersOptimizer.getMatchingFilter(PatternFiltersOptimizer.java:184)
     at oracle.ide.util.PatternFilters.findMatchingFilter(PatternFilters.java:145)
     at oracle.ide.util.PatternFilters.isIncluded(PatternFilters.java:164)
     at oracle.ide.util.IntersectedFilters.isIncluded(IntersectedFilters.java:145)
     at oracle.ideimpl.index.file.AbstractFileTable.filePassesFilters(AbstractFileTable.java:706)
     at oracle.ideimpl.index.file.DirFileTable.updateDir(DirFileTable.java:368)
     at oracle.ideimpl.index.file.DirFileTable.processQueue(DirFileTable.java:288)
     at oracle.ideimpl.index.file.DirFileTable.fullUpdate(DirFileTable.java:201)
     at oracle.ideimpl.index.file.DirFileTable.updateFileTable(DirFileTable.java:136)
     at oracle.ideimpl.index.file.AbstractFileTable.update(AbstractFileTable.java:379)
     at oracle.ideimpl.index.file.AbstractFileTable$FileTableUpdater.call(AbstractFileTable.java:914)
     at oracle.ideimpl.index.file.AbstractFileTable$FileTableUpdater.call(AbstractFileTable.java:903)
     ... 5 more
oracle.ide.index.LockFailedException: java.lang.IllegalArgumentException: URLDecoder: Illegal hex characters in escape (%) pattern - For input string: ".j"
o.ii.index.IndexRoot.lock(IndexRoot.java:319)
o.ii.index.IndexImpl.lock(IndexImpl.java:161)
o.ii.searchbar.index.IndexProvider.searchProject(IndexProvider.java:272)
o.ii.searchbar.index.IndexProvider.search(IndexProvider.java:178)
o.ii.searchbar.BaseController$SearchTask.run(BaseController.java:213)
j.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
j.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
j.util.concurrent.FutureTask.run(FutureTask.java:138)
j.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
j.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
j.lang.Thread.run(Thread.java:619)
Caused by:
java.lang.IllegalArgumentException: URLDecoder: Illegal hex characters in escape (%) pattern - For input string: ".j"
j.net.URLDecoder.decode(URLDecoder.java:173)
j.net.URLDecoder.decode(URLDecoder.java:83)
o.i.util.PatternFilter.matchesImpl(PatternFilter.java:285)
o.i.util.PatternFilter.matches(PatternFilter.java:138)
o.i.util.PatternFiltersOptimizer$VanillaEvaluator.matches(PatternFiltersOptimizer.java:118)
o.i.util.PatternFiltersOptimizer.getMatchingFilter(PatternFiltersOptimizer.java:184)
o.i.util.PatternFilters.findMatchingFilter(PatternFilters.java:145)
o.i.util.PatternFilters.isIncluded(PatternFilters.java:164)
o.i.util.IntersectedFilters.isIncluded(IntersectedFilters.java:145)
o.ii.index.file.AbstractFileTable.filePassesFilters(AbstractFileTable.java:706)
o.ii.index.file.DirFileTable.updateDir(DirFileTable.java:368)
o.ii.index.file.DirFileTable.processQueue(DirFileTable.java:288)
o.ii.index.file.DirFileTable.fullUpdate(DirFileTable.java:201)
o.ii.index.file.DirFileTable.updateFileTable(DirFileTable.java:136)
o.ii.index.file.AbstractFileTable.update(AbstractFileTable.java:379)
o.ii.index.file.AbstractFileTable$FileTableUpdater.call(AbstractFileTable.java:914)
o.ii.index.file.AbstractFileTable$FileTableUpdater.call(AbstractFileTable.java:903)
j.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
j.util.concurrent.FutureTask.run(FutureTask.java:138)
j.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
j.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
j.lang.Thread.run(Thread.java:619)
About
Oracle JDeveloper 11g Release 1 11.1.1.2.0
Studio Edition Version 11.1.1.2.0
Build JDEVADF_11.1.1.2.0_GENERIC_091029.2229.5536
Copyright © 1997, 2009 Oracle and/or its affiliates. All rights reserved.
IDE Version: 11.1.1.2.36.55.36
Product ID: oracle.jdeveloper
Product Version: 11.1.1.2.36.55.36
Version
Component     Version
=========     =======
ADF Business Components     11.1.1.55.36
Java(TM) Platform     1.6.0_14
Oracle IDE     11.1.1.2.36.55.36
Versioning Support     11.1.1.2.36.55.36

:) yeah it's a super useful search box especially with projects with lots of files nested down in some deep packages ;p
The interesting thing is I'm not searching for .j.
The same error message comes up regardless of what I search for.
For example:
MyFile.txt
or
FuBar
both return the same error and both report errors list .j and Illegal hex characters.... it must be some weird config thing under the hood that got munted during the install.
Edited by: T-Syd on Nov 20, 2009 9:36 AM

URLDecoder: Illegal hex characters in escape (%) pattern

hi ,
i am getting "java.lang.IllegalArgumentException: URLDecoder: Illegal hex characters in escape (%) pattern - For input string: \"\u000F\u0016\"
can any one help how to fix this issue?
Thanks and regards
Kavitha

U+000F and U+0016 are non-printing control characters that are explicitly forbidden in an URL and if I remember correctly even spell trouble when they are encoded.
If you want to transfer random byte data, then your best bet is to use some ASCII-safe encoding such as Base64 (note that you need to use a [modified Base64|http://en.wikipedia.org/wiki/Base64#URL_applications] in URLs to avoid having to double-encode "+" and "/").

How to Search for a Date in a string having both characters and date

Hi ,
I have a requirement to search DATE in the String having Both Characters and DATE . Please kindly let me know as early as possible.
Regards
Anil Kumar K

Try to use SEARCH command with the pattern, making the pattern as fine as it can, like if you have your date in the format 02/23/2007, you can give
SEARCH STRING FOR ' //'. (assuming the date has at least a single blank before it)
WRITE: SY-SUBRC UNDER 'SY-SUBRC',
SY-FDPOS UNDER 'SY-FDPOS'.
SY-FDPOS is set to offset of the string from which you can get the date value
Refer here
http://help.sap.com/saphelp_47x200/helpdata/en/fc/eb33cc358411d1829f0000e829fbfe/frameset.htm
It would have been better if there is something like UNIX "regular expression" matching in ABAP

Hex Characters in Comments Field

Hey there,
I was wondering if I could get an opinion/confirmation about something weird that I'm seeing after installing 5.0 on my Windows XP Home Operating System.
I get pretty elaborate in my Comments field, filling in Mood or "Feel" for each individual song, so I can pull up smart playlists of the exact soundtrack that I want to hear at any given time.
too much information here
So I download iTunes 5.0 and all of the sudden I notice that many of my comments have been overwritten with Hex characters.
Again, too much info here and here.
Do you think this may be related to iTunes' "SoundCheck" functionality? There is some talk on the innerweb about that, but not really confirmed anywhere.
Thoughts?
Would this make any sense?
The links I gave illustrate the issue with screenshots, pie charts and everything except blood samples, so it may help describe what I'm talking about.
Anyhoo, I'd be interested in any opinion/thoughts.
Thanks,
Zac

Is it possible that version 5 is "calling up" the wrong portion of the comment?
Possible? Obviously so. You're seeing it, after all.
Weird as ****? Definitely. It doesn't do that to me.
I don't know what to tell you other than to retag the comments on these files. I don't understand how an MP3 tag could break in that particular way. It's possible that Windows Media Player changed the tag in such a way that it damaged that bit (WMP likes to retag files that it finds without any sort of notification or anything), but it's very odd nevertheless.
There is a script available for "The Godfather" tagging program that will remove these hexadecimal comments. These comments are not actually needed by iTunes anyway, so removing them won't break anything. I don't know much about the godfather and scripting though. Go here for more info: http://users.otenet.gr/~jtcliper/tgf/

Sender IDOC with HEX characters

Hi Chaps,
I have a situation i.e. my sender IDOC is sending some HEX characters in the text fields, XI should interpret them and convert it into text fields to the target system.
Could some one guide me on the best approach for this?
Your inputs are highly appreciable.
Regards,
Vijaya

Hi,
You will need to loop at the string array and read it character by character. You can convert from HEX to unicode using the following line of code in your UDF -
char c = (char) Integer.parseInt("str", 16);
where str is the four digit HEX character at i'th position.
Hope this helps.
Regards,
Riyaz
PS: Calling community members as 'Chaps' does NOT sound professional.

How to accept only 4 or less hex characters in string control

Hi,
I want to accept only up to 4 hex characters in a string control. I dont want to use "hex display" property.
How is it possible? I have String control key down? event in event case, I tried it with regular expressions [0-9a-fA-F]{4} but then I have to accept left, right, delete, backspace, home keys as well.
Solved!
Go to Solution.

I agree with Dennis that you seem to be making life difficult for yourself. However, you did ask the equivalent (as I understand it) "How can I allow the user to type "1", "2", "Ctrl-A", "B", "Ctrl-C", "D" and get this recognized as the string "12BD". If you really want to do this, here is one way (I was lazy and left the answer as an array of 4 1-character strings). I use PlatMods to exclude having any "modification" key other than Shift down, convert the numeric Char into a string, then count acceptable Hex letters and conditionally add them to the output array, stopping when I have 4 characters.
Bob Schor

Expression to convert 8 characters to date

Hi all,
Is it possible to use SSRS expression to convert 8 characters to date?
I have the date in the following format 20150402 and I would like to convert it to date dd/MM/yyyy format.
I appreciate any help.
Thanks in advance.

Hi Matt_90,
If you want to change the value from dd/MM/yyyy to ddMMyyyy, you could use the Split() function like below:
=Split("16/04/2015","/")(0) & Split("16/04/2015","/")(1) & Split("16/04/2015","/")(2)
If you have any question, please feel free to ask.
Best regards,
Qiuyun Yu
Qiuyun Yu
TechNet Community Support

Removing non-English characters from data.

Ours is global system with some data with non-English characters. We want to download file by removing this non-English characters.
Any suggestions how we can remove these non-English characters from file..?

The FM u said
     Replace non-standard characters with standard characters
   Functionality
     SCP_REPLACE_STRANGE_CHARS processes a text so that it only contains
     simple characters. Special characters and national characters are
     replaced in such a way that the text remains reasonably legible.
     The character set 1146 is used by default. In this case the following
     replacements are made, for example:
      Æ ==> AE        (AE)
      Â ==> A         (Acircumflex)
      Ä ==> Ae        (Adieresis)
      £ ==> L         (sterling)
     Note that the new text can be longer than the old.
So i dont think it ll be useful for eliminating the sp. chars.
U have to check each and every alphabet with std 26 alphabets
Thanks & Regards
vinsee

Converting hex to number & date

Hi!
Im having a problem converting the hex code to the number & date.
select low_value,high_value from ALL_TAB_COL_STATISTICS;
Iv tried HEX_TO_CHAR and that works fine.
select column_name, UTL_I18N.RAW_TO_CHAR(low_value),UTL_I18N.RAW_TO_CHAR(high_value),low_value, UTL_I18N.RAW_TO_CHAR(high_value) from ALL_TAB_COL_STATISTICS where owner = 'user' and table_name = 'table_name';
if you type this statement you will see that numeric fields and date fields get caught up in (¿) type of fields.
Any solution for this?
BR / S-A
Edited by: SweAnderline on 2008-nov-14 12:58

Hi William!
Need your help again.
Iv taken your statement and alterd it a bit.
SELECT c.table_name table_name, c.column_name, c.data_type
, c.histogram
, CASE c.data_type
WHEN 'NUMBER' THEN TO_CHAR(UTL_RAW.CAST_TO_NUMBER(c.low_value))
WHEN 'VARCHAR2' THEN UTL_RAW.CAST_TO_VARCHAR2(c.low_value)
WHEN 'DATE' THEN
RTRIM(TO_NUMBER(SUBSTR(c.low_value,1,2),'XX') -100 ||
LPAD(TO_NUMBER(SUBSTR(c.low_value,3,2),'XX') -100,2,'0') || '-' ||
LPAD(TO_NUMBER(SUBSTR(c.low_value,5,2),'XX'),2,'0') || '-' ||
LPAD(TO_NUMBER(SUBSTR(c.low_value,7,2),'XX'),2,'0') || ' ' ||
LPAD(TO_NUMBER(SUBSTR(c.low_value,9,2),'XX') -1,2,'0') || ':' ||
LPAD(TO_NUMBER(SUBSTR(c.low_value,11,2),'XX') -1,2,'0') || ':' ||
LPAD(TO_NUMBER(SUBSTR(c.low_value,13,2),'XX') -1,2,'0'),':- ')
END AS low_val
, CASE c.data_type
WHEN 'NUMBER' THEN TO_CHAR(UTL_RAW.CAST_TO_NUMBER(c.high_value))
WHEN 'VARCHAR2' THEN UTL_RAW.CAST_TO_VARCHAR2(c.high_value)
WHEN 'DATE' THEN
RTRIM(TO_NUMBER(SUBSTR(c.high_value,1,2),'XX') -100 ||
LPAD(TO_NUMBER(SUBSTR(c.high_value,3,2),'XX') -100,2,'0') || '-' ||
LPAD(TO_NUMBER(SUBSTR(c.high_value,5,2),'XX'),2,'0') || '-' ||
LPAD(TO_NUMBER(SUBSTR(c.high_value,7,2),'XX'),2,'0') || ' ' ||
LPAD(TO_NUMBER(SUBSTR(c.high_value,9,2),'XX') -1,2,'0') || ':' ||
LPAD(TO_NUMBER(SUBSTR(c.high_value,11,2),'XX') -1,2,'0') || ':' ||
LPAD(TO_NUMBER(SUBSTR(c.high_value,13,2),'XX') -1,2,'0'),':- ')
END AS high_val
, c.num_distinct
, c.avg_col_len
, ROUND(c.density,1) AS density
, c.num_nulls, c.nullable
, round(((c.num_nulls*100)/decode(nvl(d.num_rows,1),0,1))) || '%' "Null % of total Rows"
, c.last_analyzed
, d.num_rows "Number of rows in table"
FROM all_tab_columns c, dba_tables d
WHERE c.table_name = d.table_name and c.owner like 'MDB%'
AND c.owner = d.owner
ORDER BY c.table_name asc;
What I cant get to work is my
-- round(((c.num_nulls*100)/decode(nvl(d.num_rows,1),0,1))) || '%' "Null %"
When I execute the statement I get divisor is equal to zero, so I tried to add a nvl if its null then 1, and if its 0 in number of rows then 1.
Iv tried multiple ways to do this but I cant get it to calculate. With the current statement I dont get any results.
I can get it to work if I create a view with this statement and add a specific table_name. But I need to get this to work in the whole schema/user without entering a specific table.
Any ideas what I can do else?
Thx in advance
Cheers

Problems with german characters in data migration

Hello,
I tried to migrate a Access 2002 mdb to Oracle 10g XE. In order to avoid errors I used Access 2000 exporter to generate xml and dat for table and data, imported the schema to Oracle database, generated data move scripts and imported the data with a batch-file.
I did it according to the steps explained here:
http://www.oracle.com/technology/tech/migration/workbench/viewlets/ofdm.html
http://www.oracle.com/technology/obe/11gr1_db/appdev/msamigrate/msamigrate.htm
All german characters in Table names were migrated correctly. But when I import the data, german characters are converted to weird signs like Ã¼.
If I open the dat-files with windows editor all german characters are displayed properly. If I open the same file with wordpad the german characters are displayed with the errors described above.
Environment
Win XP SP 3 German
Ms Access 2002 sp3 german
SQL Developer 1.5.0.53 german
Access 2000 Exporter 10.2.0.2.5
What am I doing wrong? I can't get it solved since two days.

Check if database characterset supports these special characters
check client's nls settings.
check client machine's language settings (converts characters in driver level)

Chinese characters in date & time - how do I delete?

Hi anybody - I have just bought a new iPad mini and am currently setting it up. What may be chinese characters are coming up in the date and time, how do I get rid of them? I have checked the keyboard and language are both English....

Thank-you! From New Zealand

Characters in data field

Hi,
Is it possible to load characters in datafield. I want to load names in the data field and while generating report for members, i should be able to get names for these members.

The attributes wouldn't be tied directly to the data, but rather to another dimension. So I don't see how that helps you.
In the case of a Yes/No type field value, you could express Y as 1 in Essbase and No as 0 or #missing. Or assign specific numeric values to key words. You would then need your interface to the data to interpret the numeric values back into their string equivalents. Obviously aggregation would not make any sense in the latter scenario.
More likely, your best bet is to consider a text mining solution. I would guess that discussion belongs in a different forum.
Cheers,
Bruce

Eliminating Hex Characters in Data

Similar Messages

Maybe you are looking for