Cleaning data before turning into WDDX

A program I am supporting is displaying behavior that seems
to imply that WDDX format cannot hold those windows specific
characters for things like "smart quotes", certain types of dashes,
etc. Right now, the application takes user input which is being
stored in cfml structures, turns it into wddx, then puts that data
into an oracle column/row. Later, the code retrieves the
column/record, and before converting it to the cfml structure, uses
the CFML MX7 IsWDDX function. This is returning false if the data
contains the Windows special characters, but returns true if I
manually go into the database and change the characters into
something else.
What I need is some code that I could use before ever
creating the WDDX record, that would find the Windows specific
characters and turn them into some sort of "valid" character.
Does anyone have any pointers to such code, or at least an
article discussing this type of thing?
Thank you.

Go to cflib.org and look for a function called
safetext.

Similar Messages

  • Can an array of data be turned into a dataset run in labview dsc 6.1

    I am reading an analog input into consecutive registers inside a plc on each scan. Then I am reading this group of registers into the dsc engine through a KEPWARE OPC server. I am using the 'read multiple tags vi' to grab all of this data into an array. can this array of data be turned into a dataset and use the run capability to log data???? The plc has a scan time of 3ms

    If you put 1000 tags in a built-in DataSet, then you will have 1000 traces, one for each. DataSet is nothing but the database except that it groups a bunch of tags (in the dataabase) and forms a "set."
    I think there's some confusion here about the terminology: dataset, traces, database, etc. I will summarize this for the benefit of all of us:
    DSC's database, Citadel, is the repository of all historiical data. Those Tags for which logging is enabled (in the SCF) will log their data in Citadel.
    This data can then be extracted and viewed either by using the Historical VIs or the built-in viewers like HDV and HTV.
    DataSet is a new feature of Citadel introduced in DSC v6.1. All this does is lets one define a set of Tags to be lo
    gged and extracted together (as sets). The data is still being stored in Citadel; and you still have to enable logging for these Tags in the SCF. However, you can query for this set of tags by their ID rather than querying each one of the Tags individually and building your own sets. So, it's a mechanism which facilitates the usability of stored data as sets.
    Hope this clarifies some stuff.
    Regards,
    Khalid

  • Depersonalising Data Before loading into DB

    Hi Guys,
    I need some help on de-Personalizing customer data before loading it into the database using SSIS.
    So one all the transformation done and finally want to load the data into respective tables , we need to de-personalize it.
    Also, how it will handle datatype of the table for each columns need to be de-personalized ?
    Later on we have to again de-cript once its tested by the testers. 
    Anky

    Hi Raj
    We have to  encrypt the data before loading the data into the table.
    As we are not encrypting the client ID that can be used to join with other tables for testing purpose but tester won’t able to see the other Client Personal Data
    like account number, address and DOB etc .
    we have to decrypt the data back once testing is done.
    Anky

  • UNIX sed commands to clean up data before loading into BI

    Hi all,
    we are trying to load the data into BI from text files.. This data needs to be cleaned before it can be loaded into BI and this has to be done using UNIX sed commands!!
    We basically need to do a data cleansing act, like removing unwanted characters (tab values and newline values as part of the characteristic values). How can it be done using unix sed commands??
    your help is very much appreciated.
    Regards

    Hi all,
    we are trying to load the data into BI from text files.. This data needs to be cleaned before it can be loaded into BI and this has to be done using UNIX sed commands!!
    We basically need to do a data cleansing act, like removing unwanted characters (tab values and newline values as part of the characteristic values). How can it be done using unix sed commands??
    your help is very much appreciated.
    Regards

  • Do We Need to Validate Data Before Loading Into Planning?

    We are debating between whether to load data from GL to Planning using ODI or FDM. If we need some form of validity check on the data, we will have to use FDM, otherwise I believe ODI is good enough.
    My question is, for financials planning, what determines whether we need validity checks or not? How do we decide that?

    FDM helps in validation for data load audit options but validation is as easy as doing a comparison to totals by GL accounts from source and planning. You should be able to use ODI, FDM or load rules to load data into Hyperion and complete validation outside using any of reporting options.

  • Clean Application before Importing into Subversion?

    Hi
    We are currently looking at implementing Subversion to control our source code.
    I've noticed when importing our ADF Faces project into the repository that a number of generated files are also included.
    The main ones being the classes directories and the temp directory under public_html/WEB-INF
    Is it safe to delete these files from the source directory before performing an import?
    It seems that performing a complete rebuild on the application gets them back.
    Further commits do not include these files?
    Any help would be greatly appreciated. Thanks
    Scott

    Hi Scott,
    I use the subversion command-line utilities for all of my SVN activities. Having said that, you could do the import using the plugin and then use the command line to set the svn:ignore property as required.
    I cannot speak to the subversion plugin capability from personal experience. I do have it installed, but I just use it so that I get the nice little state overlay icons on the files when I am in jdev.
    John

  • How to advoid Pdf attached files turning into winmail.dat file causing incovinience opening them? And why does the phone automatically changes the file???

    The first time i opened the mail, the mail loaded the attactment as pdf file and i was able to open it without any problems. But then when i tried to open it again, i watched the phone automatically turned the pdf file into winmail.dat without any of my control. Since then, i werent able to open the file anymore! And this was lucky that i was able to see it as pdf file - all other attachments i have recieved since using my new ip6 all turn into winmail.dat
    this is really incovinient and frustrating for work. i cant believe i cannot just open a pdf file as a pdf file on my ip6 in the emails i recieve. I was on ip4 before this and never have anything like this happened.
    Solution needed asap please.
    Thankyou!

    Hi Jnkm,
    I'm sorry to hear you are having issues with your new iPhone 6. If you are getting a winmail.dat file instead of a PDF, you may want to see if it may be the issue noted in the following article:
    iPhone, iPad, or iPod touch does not display attachment in email - Apple Support
    Regards,
    - Brenden

  • My Macbookpro has turned into microsoft windows and lost all data, how do I recover it with my windows 7 still inside? I accidentally install directly, Help please...

    My Macbookpro has turned into microsoft windows and lost all data, how do I recover it with my windows 7 still inside? I accidentally install directly, Help please...

    ok turn it off manually and turn it back on while holding the apple logo bottor or the function botton this will give you  an option to choose if you want to startup with osx ow windows. let me know if this works
    <Email Edited By Host>

  • When i was scrolling through my camera role today before i updated and like 100   pictures turned into a picture thats white then says PNG. Cant see the picture. What should i do?

    when i was scrolling through my camera role today before i updated and like 100 + pictures turned into a picture thats white then says PNG. Cant see the picture. What should i do?

    I seem to have fixed it by putting <div  class="clearfloat"></div> after the navigation bar?

  • Hi, My atachments /any file format/ turns into .dat when I mail them into my own iPad2. What to do??

    Hi
    When I email an attachment /any file format/ from my PC to my iPad2 the attached file turns into a .dat file
    What to do?
    Regards

    An Alias would be an email address that is delivered to a different account's inbox.
    For instance if you have  [email protected] and have [email protected] Then [email protected] would be an alias if mails from that address arrive at the icloud address.
    If you want to add a completely different account, with a spearate inbox, like an account in hotmail and one in say yahoo mail. Then as has been pointed out, you need to go into the  Settings Icon, Tap on Mail, Contacts, Calendars, and then on add account. The iPad has several services preconfigured, you can tap on one of those from the list to setup an email for that service. Such as Hotmail, Gmail etc...
    Or you can tap on other to add a personal pop3 or imap type email like from your office, or your school.

  • How can I access data on an external drive in my mac after all folders have been turned into .lnk files? I am desperate!

    I don't know what happened, I connected my external hd today and all files had been turned into that!

    I know I am going to sound really stupid when I ask this, but how do I do that? There was this folder called Recycle Bin, which I have deleted already but the files are still in the same format. I know they are in the HD 'cause of the space taken up in it, but I would like to know exactly what to do to clear the malware altogether and have access to the stuff I have again.
    Thank you very much in advance and sorry for being such a dummy

  • How to verify that the user has changed table row data before db update

    Hi all,
    Iam using Oracle ADF with EJBs.
    I have a single selection table that displays rows of data returned from a function of my data control.
    The columns of my table are editable so that the user can change the data. The user selects a row, changes the data in one or more columns of the row and saves the data by means of a submit button. The code in the submit button, identifies the row of the corresponding iterator that the user clicked on and updates the data in the database (using the 'mergeEntity' function of the EntityManager)
    Before saving the data, I want to put some logic to check whether the user has actually changed some data to avoid unnecessary updates in the database . But for this I need a technique to detect that the user has indeed changed some data in the table row.
    One technique I have been using so far was to isolate the iterator row of the table and then query the corresponding row in the database table and compare their values.
    Except from dummy, this technique is not efficient if the table contains many rows.
    Moreover, in my case I have observed that on successive updates on the same row , the query on the database returns the new values (user changed values) and not the actual values contained in the database table. This means that when the user updates an iterator row the cached data affect also the results of the SELECT statement from the actual database table!!! Isn't this strange ?
    Can somebody propose me a neat method to detect when the user has changed the the data of an iterator row ?

    Hey Alan,
    The below solution seems overly complicated to me and can not be implemented without a custom screen and/or the use of JavaScript. Also, if your main concern is that a user may accidentally loose all their data because they closed the browser window or the session times out before they hit the save button then this solution does not help you.
    There are a couple of simpler approaches you can take here:
    # If the use of JavaScript is permissible you can hook into the windows 'onUnload' event, and pop-up a message box which gives the user the opportunity to cancel closing the window and save their case if they haven't already.
    # Implement an autosave feature by hooking into one of events provided by web determinations. A simple (but rather naive) way of doing this would be to hook into the OnRenderScreenEvent and call save on the interview session every time the event fires. This guarantees that all the data the user has submitted will aways automatically be saved, thereby removing the need to make sure the user manually saves their data before closing the browser.
    Automatically making Web Determinations close a browser window has to be done using JavaScript. However, doing so means that a) it won't work for people who turn off JavaScript, which is commonly done for accessibility reasons b) you'll likely run afoul of the browser's security mechanism (they generally won't let you close a window that you didn't open and some really don't like you doing that at all).
    Thanks,
    Kristy

  • I've lost my iphone with passcode lock and find my iphone lock on but the wifi n cellular data was turned off so no way i can trace it so the only question remains is will the person who finds it be able to unlock it and use it as his own ?

    i've lost my iphone with passcode lock and find my iphone lock on but the wifi n cellular data was turned off so no way i can trace it so the only question remains is will the person who finds it be able to unlock it and use it as his own ?
    is it possible to change imei number?
    i've tried for so many times n still the phone is offline so i've set it to offline mode with my message but it never shows the last location why?

    If the device is found, nobody can use it without knowing your Apple ID and password.
    The phone will only show it's location if it is connected to cellular network or Wi-Fi. If those options are switched off, you can't locate the phone.
    With iOS 7, Find My iPhone includes a new feature called Activation Lock, which is designed to prevent anyone else from using your iPhone, iPad, or iPod touch if you ever lose it. It starts working the moment you turn on Find My iPhone in iOS 7. With Activation Lock, your Apple ID and password will be required before anyone can:
    Turn off Find My iPhone on your device
    Erase your device
    Reactivate and use your device
    This can help you keep your device secure, even if it is in the wrong hands, and can improve your chances of recovering it. Even if you erase your device remotely, Activation Lock can continue to deter anyone from reactivating your device without your permission. All you need to do is keep Find My iPhone turned on, andremember your Apple ID and password.
    What steps should I take if I misplace my device?
    If you ever misplace your device—whether it’s just lost or you think it may have been stolen—you should put it into Lost Mode immediately using Find My iPhone.
    Lost Mode locks your screen with a four-digit passcode and lets you display a custom message with your phone number to help you get it back. You can also remotely erase your device if needed, and your custom message will continue to display even after the device is erased.
    While Activation Lock works in the background to make it more difficult for someone to use or sell your missing device, Lost Mode clearly indicates to anyone who finds your device that it still belongs to you and can’t be reactivated without your password.
    To put a device into Lost Mode, sign in to icloud.com/find from a Mac or PC or use the Find My iPhone iOS app.
    For more information, read what to do if your device is lost or stolen.
    copied from iCloud: Find My iPhone Activation Lock in iOS 7

  • MacBook doesn't turns into sleep mode and swop doesn't work.

    MacBook doesn't turns into sleep mode and swop doesn't work.
    Can you help me please. I have a MacBook Pro 8.2. I reinstalled OS X to make swop file working, but it still doesn't work. I reinstalled OS X from Internet recovery.
    Start time: 10:31:02 03/15/15
    Model Identifier: MacBookPro8,2
    System Version: OS X 10.10.2 (14C109)
    Kernel Version: Darwin 14.1.0
    Time since boot: 3 minutes
    Memory
        BANK 0/DIMM0:
          Size: 4 GB
          Speed: 1333 MHz
          Status: OK
          Manufacturer: 0x029E
        BANK 1/DIMM0:
          Size: 4 GB
          Speed: 1333 MHz
          Status: OK
          Manufacturer: 0x029E
    SerialATA
       TOSHIBA MK5065GSXF                     
    Diagnostic reports
       2015-03-15 Boom 2 crash
       2015-03-15 com.apple.internetaccounts crash
    Log
       Mar 15 10:26:10 memorystatus_thread: idle exiting pid 546 [tccd]
       Mar 15 10:26:11 memorystatus_thread: idle exiting pid 547 [nsurlstoraged]
       Mar 15 10:26:12 memorystatus_thread: idle exiting pid 544 [soagent]
       Mar 15 10:26:13 memorystatus_thread: idle exiting pid 548 [nsurlstoraged]
       Mar 15 10:26:43 memorystatus_thread: idle exiting pid 556 [com.apple.CodeSi]
       Mar 15 10:26:44 memorystatus_thread: idle exiting pid 558 [accountsd]
       Mar 15 10:26:45 memorystatus_thread: idle exiting pid 553 [com.apple.iCloud]
       Mar 15 10:26:46 memorystatus_thread: idle exiting pid 561 [networkd_privile]
       Mar 15 10:26:47 memorystatus_thread: idle exiting pid 555 [secinitd]
       Mar 15 10:26:48 memorystatus_thread: idle exiting pid 560 [tccd]
       Mar 15 10:26:49 memorystatus_thread: idle exiting pid 562 [secd]
       Mar 15 10:26:50 memorystatus_thread: idle exiting pid 554 [com.apple.intern]
       Mar 15 10:26:51 memorystatus_thread: idle exiting pid 565 [nsurlstoraged]
       Mar 15 10:26:52 memorystatus_thread: idle exiting pid 563 [soagent]
       Mar 15 10:26:53 memorystatus_thread: idle exiting pid 551 [syncdefaultsd]
       Mar 15 10:26:54 memorystatus_thread: idle exiting pid 557 [CoreServicesUIAg]
       Mar 15 10:26:55 memorystatus_thread: idle exiting pid 567 [iconservicesd]
       Mar 15 10:26:56 memorystatus_thread: idle exiting pid 566 [iconservicesagen]
       Mar 15 10:26:57 memorystatus_thread: idle exiting pid 568 [systemstatsd]
       Mar 15 10:26:58 memorystatus_thread: idle exiting pid 550 [cfprefsd]
       Mar 15 10:26:59 memorystatus_thread: idle exiting pid 552 [cfprefsd]
       Mar 15 10:27:00 memorystatus_thread: idle exiting pid 549 [coreduetd]
       Mar 15 10:27:01 memorystatus_thread: idle exiting pid 564 [nsurlstoraged]
       Mar 15 10:28:18 ** GPU Hardware VM is disabled (multispace: disabled, page table updates with DMA: disabled)
       Mar 15 10:29:09 proc 316: load code signature error 4 for file "Boom 2"
    I/O per process: coresymbolicati (UID 0) is using 15 MB/s
    kexts
       com.globaldelight.driver.Boom2Device (1.1)
    Daemons
       com.apple.installer.osmessagetracing
    Agents
       com.apple.AirPortBaseStationAgent
       com.globaldelight.Boom2Daemon
    Extensions
       /Library/Extensions/Boom2Device.kext
       - com.globaldelight.driver.Boom2Device
       /System/Library/Extensions/EPSONUSBPrintClass.kext
       - com.epson.print.kext.USBPrintClass
       /System/Library/Extensions/JMicronATA.kext
       - com.jmicron.JMicronATA
    Applications
       /Applications/Boom 2.app
       - com.globaldelight.Boom2
       /Applications/Boom 2.app/Contents/Library/LoginItems/Boom2Daemon.app
       - null
    Bundles
       /Library/Printers/Canon/BJPrinter/Plugins/BJNP/CIJNetworkIOM.plugin
       - jp.co.Canon.ij.print.iom.CIJNP
       /Library/Printers/Canon/BJPrinter/Plugins/BJNP/CIJNetworkPBM.plugin
       - jp.co.Canon.ij.print.pbm.CIJNP
       /Library/Printers/Canon/BJPrinter/Plugins/BJUSB/BJUSBIOM.plugin
       - jp.co.canon.bj.print.bjusbiom
       /Library/Printers/Canon/BJPrinter/Plugins/BJUSB/BJUSBPBM.plugin
       - jp.co.canon.bj.print.pbm.USB
       /Library/Printers/Canon/BJPrinter/Plugins/BJUSB/CIJUSBClassDriver.plugin
       - jp.co.canon.ij.print.CIJUSBClassDriver
       /Library/Printers/Canon/BJPrinter/Plugins/BJUSB/CIJUSBClassDriver2.plugin
       - jp.co.canon.ij.print.CIJUSBClassDriver2
       /Library/Printers/Canon/BJPrinter/Plugins/IJBluetooth/IJBluetoothIOM.plugin
       - jp.co.canon.ij.print.ijbluetoothiom
       /Library/Printers/EPSON/CIOSupport/CIOHelper.plugin
       - com.epson.print.plugin.CIOHelper
       /Library/Printers/EPSON/CIOSupport/EPSONUSBPrintClass.plugin
       - com.epson.print.plugin.USBPrintClass
       /Library/Printers/EPSON/CIOSupport/XIOP.plugin
       - com.epson.print.plugin.XIOP
       /Library/Printers/EPSON/CIOSupport/XIORemoteClient.plugin
       - com.epson.print.plugin.XIORemoteClient
       /Library/Printers/EPSON/CIOSupport/XIORemoteServer.plugin
       - com.epson.print.plugin.XIORemoteServer
    Restricted files: 219
    Elapsed time (s): 238

    Remove "Boom" and test.
    Any third-party software that doesn't install by drag-and-drop into the Applications folder, and uninstall by drag-and-drop to the Trash, is a system modification.
    Whenever you remove system modifications, they must be removed completely, and the only way to do that is to use the uninstallation tool, if any, provided by the developers, or to follow their instructions. If the software has been incompletely removed, you may have to re-download or even reinstall it in order to finish the job.
    I never install system modifications myself, and except as stated in this comment, I don't know how to uninstall them. You'll have to do your own research to find that information.
    Here are some general guidelines to get you started. Suppose you want to remove something called “BrickMyMac” (a hypothetical example.) First, consult the product's Help menu, if there is one, for instructions. Finding none there, look on the developer's website, say www.brickmymac.com. (That may not be the actual name of the site; if necessary, search the Web for the product name.) If you don’t find anything on the website or in your search, contact the developer. While you're waiting for a response, download BrickMyMac.dmg and open it. There may be an application in there such as “Uninstall BrickMyMac.” If not, open “BrickMyMac.pkg” and look for an Uninstall button. The uninstaller might also be accessed by clicking the Customize button, if there is one.
    Back up all data before making any changes.
    You will generally have to restart the computer in order to complete an uninstallation. Until you do that, there may be no effect, or unpredictable effects.
    If you can’t remove software in any other way, you’ll have to erase and install OS X. Never install any third-party software unless you're sure you know how to uninstall it; otherwise you may create problems that are very hard to solve.
    Trying to remove complex system modifications by hunting for files by name often will not work and may make the problem worse. The same goes for "utilities" such as "AppCleaner" and the like that purport to remove software.

  • ODI : how to raise cross reference error before loading into Essbase?

    Hi John .. if you read my post, I want to say that you impress me! really, thank for your blog.
    Today, my problem is :
    - I received a bad quality data file from ERP extract
    - I have cross reference table (Source ==> Target)
    - >> How to raise the error before loading into Essbase !
    My Idea is the following, (first of all, I'm not sure if it is a good one, and also I meet issue to do it in ODI !)
    - Step 1 : make JOIN between data.txt and cross-reference Table ==> Create a table DATA_STEP1 in the ODISTAGING schema (the columns of DATA_STEP1 are the addition of columns of data.txt those of cross-references Tables (... there is more than 20 columns in my case)
    - Step 2 : Control if there is no NULL value in the Target Column (NULL means that the data.txt file contains value that are not defined in my cross reference Table) by using Filter ( Filter = Target_Account IS NULL or Target_Entity IS NULL or ...)
    The result of this interface is send to reject.txt file - if reject.txt file is not empty then a mail is sent to the administrator
    - Step 3 : make the opposite : Filter NOT (Target_Account IS NULL or Target_Entity IS NULL ... ) ==> the result is sent in DATA_STEP3 Table
    - Step 4 : run properly the mapping : source : DATA_STEP3 (the clean and verified data !) with cross reference Tables and send data into Essbase - NORMALY, there is not rejected record !
    My main problem is : what is the right IKM to send data into the DATA_STEP1, or DATA_STEP3 Table, which are Oracle Table in my ODISTAGING Schema ! I thy with IKM Oracle Incremental Update but I get error, and actually I don't need an update (which is time consumming), I just need an INSERT !
    I'm just lookiing for an 'IKM SQL to Oracle" ....
    regards
    xavier

    Thanks john : very speed !
    I understood better now which IKM is useful.
    I found other information about the error followup with ODI : http://blogs.oracle.com/dataintegration/2009/10/did_you_know_that_odi_generate.html
    and I decided to activate Integrity Constorl in ODI :
    I load :
    - data.txt in ODITEMP.T_DATA
    - transco_account.csv in ODITEMP.T_TRANSCO_ACCOUNT
    - transco_entity.csv in ODITEMP.T_TRANSCO_ENTITY
    - and so on ...
    - Moreover I create integrity constraints between T_DATA and T_TRANSCO_ACCOUNT and T_TRANSCO_ENTITY ... so I expected that ODI will raise for me in E$_DATA (the error table) the bad records !
    However I have one issue when loading data.txt into T_DATA because I have no ID or Primary Key ... I read in a training book that I could use a SEQUENCE ... I try but unsuccessful ... :-(
    Is there another simple way to create a Primary Key automaticaly (T_DATA is in an oracle Schema of course) ?thanks in advance

Maybe you are looking for