Oracle DQ - Setup the Data File
I installed the 10.1.3.4 and Data QUality and Profiling for ODI, and working on the Sample Tutorial ( 10g Release 3). On page 5, it says that there exists a oracle DQ's sample file, oracledq_sample_data.zip. Where can I find the file?
Thank you.
I installed ODI 10.1.3.4 on my machine. When I tried to run the Data Quality Metabase Manager or Data Profiling and Quality I get <file not found> error.
Discovery.exe or admin.exe --> is there any additional settings I should add to fix this issue?
Similar Messages
-
SQL Loader and foreign characters in the data file problem
Hello,
I have run into an issue which I can't find an answer for. When I run SQL Loader, one of my control files is used to get file content (LOBFILE) and one of the fields in the data file has a path to that file. The control file looks like:
LOAD DATA
INFILE 'PLACE_HOLDER.dat'
INTO TABLE iceberg.rpt_document_core APPEND
FIELDS TERMINATED BY ','
doc_core_id "iceberg.seq_rpt_document_core.nextval",
-- created_date POSITION(1) date "yyyy-mm-dd:hh24:mi:ss",
created_date date "yyyy-mm-dd:hh24:mi:ss",
document_size,
hash,
body_format,
is_generic_doc,
is_legacy_doc,
external_filename FILLER char(275) ENCLOSED by '"',
body LOBFILE(external_filename) terminated by EOF
A sample data file looks like:
0,2012-10-22:10:09:35,21,BB51344DD2127002118E286A197ECD4A,text,N,N,"E:\tmp\misc_files\index_testers\foreign\شیمیایی.txt"
0,2012-10-22:10:09:35,17,CF85BE76B1E20704180534E19D363CF8,text,N,N,"E:\tmp\misc_files\index_testers\foreign\ลอบวางระเบิด.txt"
0,2012-10-22:10:09:35,23552,47DB382558D69F170227AA18179FD0F0,binary,N,N,"E:\tmp\misc_files\index_testers\foreign\leesburgis_á_ñ_é_í_ó_ú_¿_¡_ü_99.doc"
0,2012-10-22:10:09:35,17,83FCA0377445B60CE422DE8994900A79,binary,N,N,"E:\tmp\misc_files\index_testers\foreign\làm thế nào bạn làm ngày hôm nay"
The problem is that whan I run this, SQL Loader throws an error that it can't find the file. It appears that it can't interpret the foreign characters in a way that allows it to find that path. I have tried adding a CHARACTERSET (using AL32UTF8 or UTF8) value in the control file but that only has some success with Western languages, not the ones listed above. Also, there is no set of defined languages that could be found in the data file. It essentaially could be any language.
Does anyone know if there is a way to somehow get SQL Loader to "understand" the file system paths when a folder and/or file name could be in some other langauge?
Thanks for any thoughts - PeterThanks for the reply Harry. If I try to open the file in various text editors like Wordpad, Notepad, GVIM, andTextpad, they all display the foreign characters differently. Only Notepad comes close to displaying the characters properly. I have a C# app that will read the file and display the contents and it renders it fine. If you look at the directory of files in Windows Explorer, they all are displayed properly. So it seems things like .Net and Windows have some mechanism to understand the characters in order to render them properly. Other applications, again like Wordpad, do not know how to render them properly. It would seem that whatever SQL Loader is using to "read" the data files also is not rendering the characters properly which prevents it from finding the directory path to the file. If I add "CHARACTERSET AL32UTF8" in the control file, all is fine when dealing with Western langauges (ex, German, Spanish) but not for the Eastern languages (ex. Thai, Chinese). So .... telling SQL Loader to use a characterset seems to work, but not in all cases. The AL32UTF8 is the characterset that the Oracle database was created with. I have not had any luck if I try to set the CHARACTERSET to whatever the Thai character set is, for example. There problem there though is that even if that did work, I can't target specific lagauages because the data could come from anywhere. It's like I need some sort of global "super set" characterset to use. It seems like the CHARACTERSET is the right track to follow but I am not sure, and even if it is, is there a way to handle all languages.
Thanks - Peter -
Oracle 11g unreasonable large data file that can't be shrunk
I got this Oracle 11g installed on my win7 just for running my local application. In the Enterprise Manager the "USERS" tablespaces shows over 12g for allocated size, about 1g for Space Used(also see the table snippet below), only about 8% of space is used. However, when I tried to shrink the data file/space even to half of its current size, both from command line(resize) and Enterprise Manager, i got the error that says "Failed to commit: ORA-03297: file contains used data beyond requested RESIZE value ". I was able to resize my TEMP tablespace successfully with the same command.
Any insight on this? thanks a lot. I'm about to run out my hard drive space.
Name / Allocated Size(MB) /Space Used(MB) /Allocated Space Used(%) /Auto Extend /Allocated Free Space(MB) /Status Datafiles /Type /Extent Management /Segment Management
USERS / 12,288.0 /1,026.7 /8.4 /YES /11,261.3 / /1 /PERMANENT /LOCAL /AUTOJonathan Lewis wrote:
user1340127 wrote:
However, when I tried to shrink the data file/space even to half of its current size, both from command line(resize) and Enterprise Manager, i got the error that says "Failed to commit: ORA-03297: file contains used data beyond requested RESIZE value ". I was able to resize my TEMP tablespace successfully with the same command.
Any insight on this? thanks a lot. I'm about to run out my hard drive space.
You have an object stored at the end of the datafile, you will need to move it down the file (or to another tablespace) before you can shrink the file. I though OEM had a "tablespace map" feature to help you see what objects were located where but if not, see:In EM (or 10g dbconsole, at any rate), you select a tablespace, drop down menu Show Tablespace Contents, then there is a tablespace map icon to expand the map. It can be slow. Then you can scroll down to the bottom, scroll up and look for where the last non-green extents are. Also, you can find the beginning of datafiles (if you have multiple data files in the tablespace) by watching for purple header blocks. Hovering over the segments gives information, and clicking on them (or selecting segments in the contents list up above) shows where all the extents are in yellow. I haven't tried the reorganize link... -
What are the versions required for JBOSS,JDK and ORACLE to setup the ATG 10.2.
Hi Folks,
Could you please share, What are the versions required for JBOSS, JDK and ORACLE to setup the ATG 10.2.
Thank you.In case you don't have access to MOS :
JBOSS : 5.1.2 EAP
JDK : 1.6.0_38
ORACLE :
Oracle Exadata5
Oracle 10gR2 (10.2.0.3)
Oracle 10gR2 RAC (10.2.0.3)
Oracle 11gR2 (11.2.0.2.0)
Oracle 11gR2 RAC (11.2.0.2.0) -
How to setup the dad file for SSO.
Hi
We need to setup the dad file for SSO. Can any one help us to setup the dad file.
Thanks,
Arvind GoelHi
It seems that SSO is for AppEx Application Authentication only. You can't specify which Database User your application will connect to the database with if you are authenticating using SSO.
I came up against this in the following thread.
Re: How can an AppEX Application work with DB users referenced in DB Trigge
G. -
Clear Data package - "The data file is empty." Error
Hi,
When I run the Clear package in Data Manager, I get the error "The data file is empty". We are running BPC 7.5 SP3. There are no calculated members selected. Any suggestions?
Thanks.
TomHi Tom,
If i'm not mistaken when we run the clear data package, BPC inserts -ve values for the combination of dimensions selected.
For ex if you have selected time as 2010.DEC it would reverse out all these values by inserting negative values which would then total up to zero.
So i still think it could be a problem with the Transformation file.
P.S. Maybe you can try using the Clear from Fact table package.
Santosh -
I have written a binary file with a specific header format in LABVIEW 8.6 and tried to Read the same Data File, Using LABVIEW 7.1.Here i Found some difficulty.Is there any way to Read the Data File(of LABVIEW 8.6), Using LABVIEW 7.1?
I can think of two possible stumbling blocks:
What are your 8.6 options for "byte order" and "prepend array or string size"?
Overall, many file IO functions have changed with LabVIEW 8.0, so there might not be an exact 1:1 code conversion. You might need to make some modifications. For example, in 7.1, you should use "write file", the "binary file VIs" are special purpose (I16 or SGL). What is your data type?
LabVIEW Champion . Do more with less code and in less time . -
Data Integrator has no read permissions to get the data file using FTP
Hi,
I wonder if you could help.
We have installed the data integrator and are using FTP to get the data file from the SAP server to the DI server. The files are created by the SAP admin user with permissions 660. The FTP user is not in the sapsys group so cannot read the files.
Has anyone come accross this problem and how did you solve it?
Many thanks.Hi,
you might want to put you entry into the EIM forum where also the Data Integrator topics are being handled:
Data Services and Data Quality
Ingo -
How can I put the signature into the data file.
Hi all,
I want to put the signature into the data file, mean the data file will be on the top and the signature will be at the buttom.how can i do that?
Thanks.
example:-
dataFile.txt
Name=...
Address=...
Signature=6A07C70E....123FEAB(Hex)Thanks for your reply.
First, i have a keypair (public key and private key).
I use the private key to initialize the Signature and
use the Signature to sign a data file ( dataFile.txt) .
So when i need to comfirm the data file not being modify
I have to verify the data file with the Signature and the public key.
I hardcoded the public key in my program so my client (receiver of data)
need only the Signature file and the data file (2 files).
So how can i combine the Signature file and the data file into 1 file? -
Pls help me to count the no of occurence of each word in the data file
I want to count the no of occurence of each word the data file..
anybody help me out to solve this ,,
I have attached my code hereby...
import java.io.*;
import java.util.*;
import java.util.Collections;
import javax.print.attribute.standard.Media;
class WordCounter1 {
String s;
String word;
public static void main (String[] args){
WordCounter1 simpleCounter= new WordCounter1();
try
File firstFile=new File("C:/Documents and Settings/janmala/file4.txt");
simpleCounter.countWords(firstFile);
catch(Exception e)
System.err.println(e);
void countWords(File inputFile)
int count=0;
int key=0;
LinkedHashMap lhm=new LinkedHashMap();
try{
FileInputStream fin=new FileInputStream(inputFile);
DataInputStream din=new DataInputStream(fin);
while(din.available()!=0){
s=din.readLine();
StringTokenizer st=new StringTokenizer(s);
while(st.hasMoreTokens())
word=st.nextToken();
lhm.put(word,count);
if(lhm.containsKey(word))
lhm.get(word);
count++;
System.out.println(word);
System.out.println(count);
int a=lhm.size();
System.out.println("The size of Hash map"+a);
Set set = lhm.entrySet();
Iterator it = set.iterator();
while(it.hasNext())
Map.Entry me = (Map.Entry)it.next();
System.out.println(me.getValue()+":"+me.getKey());
catch(Exception e)
System.err.println(e);
}}jan07 wrote:
anybody help me out to solve this ,,Solve what?
Don't just dump a pile of unformatted code and expect someone to magically fix it for you.
Post code, hightlight it and click the CODE button to retain formatting
Include error messages if you get them
Ask an actual question -
Where is the data file for the address book located, I need to restore mine from backup but don't know where it is to do so. Putting my Mac Pro onto icloud synching contacts resulted in duplicate and triplicates of the same cards. I have a few THOUSAND contacts and the last time this happened was on mobile me. that had a function where you could replace info on the mobile me server with info on the computer. I see no way to do that on the new cloud.
In the stupidly hidden user's Library->/Application Support/AddressBook/ labeled as AddressBook-v22.abcddb
For TM restores, see Pondini's TM FAQs for starters, since I don't use TM. -
Where are the data files stored?
I regularly back up using Time Machine, but when I reformatted my hard drive and then restored it, I could not find the data files for iWeb websites I have created. Looking for help, I saw a reference to a subdirectory named "Domain", I found that but could not see any files for the four different websites I have created. Are these data files kept hidden? I am not very familiar with MAC file systems, so please respond in a MAC for Dummies language. Thanks.
In Lion and Mountain Lion the Home/Library folder is now invisible. To make it permanently visible enter the following in the Terminal application window: chflags nohidden ~/Library and hit the Enter button - 10.7: Un-hide the User Library folder. Then it will be easy to fine the domain file in your Users/Home/Library/Application Support/iWeb folder.
To open your domain file in Lion or Mountain Lion or to switch between multiple domain files Cyclosaurus has provided us with the following script that you can make into an Applescript application with Script Editor. Open Script Editor, copy and paste the script below into Script Editor's window and save as an application.
do shell script "/usr/bin/defaults write com.apple.iWeb iWebDefaultsDocumentPath -boolean no"delay 1
tell application "iWeb" to activate
You can download an already compiled version with this link: iWeb Switch Domain.
Just launch the application, find and select the domain file in your Home/Library/Application Support/iWeb folder that you want to open and it will open with iWeb. It modifies the iWeb preference file each time it's launched so one can switch between domain files.
WARNING: iWeb Switch Domain will overwrite an existing Domain.sites2 file if you select to create a new domain in the same folder. So rename your domain files once they've been created to something other than the default name.
OT -
Concatenating the data file(Mbrs) before loading.. due to change in Outline
We have 8 Dimensions(11.1.1.3)
The data file is coming from the source system in this format from 3 yrs as below ..
D1 D2 D3 D4 D5 D6 Product, Curriency
. , . ,. , . , . , ., a , USD
. , . , ., . , . , . , a , EUR
. , . , . , . , . , ., b , GBP
. , . , . , . , . , . , b , INR
Now the product name as been changed in outline as
a_USD
a_EUR
b_GBP
b_INR
So, Is there any way in the hyperion suite(like in rules file or any other), where I can concatenate Product and currency and get the file as
D1 D2 D3 D4 D5 D6 , Product , Curriency
. . . . . . , a_USD , USD
. . . . . . , a_EUR , EUR
. . .. . . . , b_GBP , GBP
. . . . . . , b_INR , INR
Please do let me know
Thanks in Advance.
Edited by: 838300 on Sep 27, 2011 9:00 AMWhile what Mehmet wrote is correct, if this is anything more than a quick and dirty fix, may I suggest you go down another ETL path? (Yes, this is Cameron's load rule rant coming right at you, but in abbreviated form.)
ETL in a load rule is great to get the job done, but is a pain to maintain. You would be (unpleasantly) surprised how these have a way of growing. Have you given a thought to fixing it at the source or doing some true ETL in a tool like ODI, or staging it in SQL and doing the mods there? I know, for a simple(ish) change, that seems overkill, but load rules for the purposes of ETL are Evil.
Regards,
Cameron Lackpour
P.S. For anyone who must see me go bonkers over this, see: http://www.network54.com/Forum/58296/thread/1311019508/Data+Load+Optimization+-Headervs+Column -
Hi All,
We are working on the redistribution process of data files in SQL level. We knew that by doing the empty files options through shrink we could achieve it. But I would like to know, Is there any things which I need to consider in terms of number of data files(Any Formula to arrive a total number of data files for the better performance in SQL database level).
In my environment, the current database size is 420GB and its running with 24 data files, SAP advised us to minimize the data files because the data files are not in order (Like 1 data file having GB and some having 40GB and few having 90GB) - So, SAP recommended us to maintain the data file size as common and distribute the data equally among the files.
So, wondering the data file size and also number according to our environment (It would be kind if you suggest on it)
Database size :420GB
Database version : SQL 2005
CPU core : 4 cores running and its a Xeon processor
Regards
VijayHi,
But I would like to know, Is there any things which I need to consider
in terms of number of data files (Any Formula to arrive a total number of data files
for the better performance in SQL database level).
You can refer Topic "Number and Size of SQL Server Data Files" of this [Best Practice document|http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/4ab89e84-0d01-0010-cda2-82ddc3548c65&overridelayout=true] (Page no.37 to 44 ). I hope you will get all the required information ,which can be considered for File Management in SQL server.
Also you can refer the following SAP Notes to get more information.
Note 987961 - FAQ: SQL Server I/O performance
Note 363018 - File management for SQL Server
Note 1488135 - Database compression for SQL Server
Regards,
Bhavik G. Shroff -
Where are the data files?
Hi,
I'm completely new to Berkeley db and i have some basic questions regarding architecture which i couldnt find in docs. Where does BDB store its data? Is there a default file location? Also, is there a way i can specify maximum file size? I'm developing an application which will store many giga bytes of data and I dont want the data files to grow above the OS limit. I'm using windows as the OS.
regards,Hello,
This question is probably deserving of its own thread, but I'll answer briefly here. As you've noted, BDB XML itself it designed and tuned to storage and query of XML. Because BDB XML is built on Berkeley DB, you can use DB proper transactionally along with BDB XML. In an application such as yours, you could store XML in BDB XML, and create (application-provided) references between those documents and other data stored in Berkeley DB. In addition, you might want to store some data in regular files (streaming video, large binary data, etc).
You can store binary data in BDB XML as either document metadata or encoded into ascii, but for the scale you want I would not recommend that approach.
Regards,
George
Maybe you are looking for
-
Everytime I want to send a file to the trash, I have to either perform some kind of key combination/shortcut or use the trackpad/mouse, right click and select "move to trash", or drag the file(s) to the trash! This is absolutely ridiculous. Why can
-
How can I get my e-mails when I get a message that the folder inbox is full?
I can't get my e-mail and the e-mails in my inbox have disappeared from Thunderbird, (but not from my server's web mail), so I can't divide it into several folders on Thunderbird to alleviate the problem. I don't know what happened to my old e-mails
-
Easy way of procesing files using sender File/FTP adapter
Hi experts, In order to process files with a sender file adapter I am interested in avoiding processing non completed files. I mean files that are still being sent. My provider send an .XML file and when the sending is completed a .CTL file with the
-
Hi, Ive created an html snippet and correctly got my flash menu swf file to load in on my website. The issue i have is that when i click on a link on my flash menu bar it frames the next page on top of the current flash instead of loading the new pag
-
Is the iPhone 4 getting the IOS 8 in the fall
i want kno because i dont know if i met be able to get it on my iphone 4