Data quality
How can i check that the data thats displayed in the Query report is the correct data ?
Where and how do we check this?
Hi,
You can do this multiple ways. You can check the infoprovider by looking at contents or using LISTCUBE to make sure what is in the infoprovider is being correctly reflected in your query.
If you are loading data from say a r3 system without any filters or logic or minimun logic, you can go back to the system and then check.
Some people compare the same reports from 2 different systems.
Basically, you can do it whichever way you want based on the situation.
Cheers,
Kedar
Similar Messages
-
Data Integrator and Data Quality
Hi,
I worked on BI 7.0 and now exploring Business objects. I wanted to know how Data Integrator and Data Quality products relate to SAP BI 7. What is the purpose of using them. Is this integration and quality features not embedded in SAP BI 7.BI and Data Services share many integration features, but Data Service provides better connectivity to third party data sources. The data quality features of Data Services are not available in BI.
-
Data quality check or automation
Apart from passing the report to the user for testing are there ways the process can be automated for a data quality check and how?
Thanks.Hi Dre01,
According to your description, you want to check the report data quality. Right?
In Reporting Services, the only way to check the report data is viewing the report. So for your requirement, if you want to make this data processing automatically. We suggest to create subscription, it will process the data automatically based
on the schedule and you will get the subscription of report to check if it shows data properly.
Reference:
Create, Modify, and Delete Standard Subscriptions (Reporting Services in Native Mode)
If you have any question, please feel free to ask.
Best Regards,
Simon Hou -
Hi:
I'm very interested in data quality and I'd like to know where to begin and which Oracle tools help to support activities like data auditing, data profiling and data cleansing.
I'm an OWB user but I don't like the way this tool performs data profiling, it creates a materialized view for every column on the table to be analyzed, so it takes many time performing that and then produces a lot of tables with the statistics gathered. I think there would be a better implementation for this.
Thanks for the forum,
Hazbleydi C.One problem is that the data quality and profiling functions built into the Oracle database cannot be used in a heterogeneous implementation like Fusion - and most of the good data quality vendors have already been acquired (FirstLogic, Vality, Similarity, Fuzzy Logistics). Informatica would be a multi-billion dollar acquisition which may be too expensive for an Oracle data integration stack. Oracle may rely on partnerships with Informatica, IBM and Trillium to provide a wide range of data quality and profiling functions.
Gartner thinks everyone is looking up in the Magic Quadrant for Data Quality Tools, 2007 -
Hi All,
I have utilized the DQS for my organization Data Cleansing project. And we have built Data Quality reports using DQ output.
We also use Profiler Summary report in the Activity Monitor, but this is manual process where Data owners need to manually enter into the Activity monitor and generet the porofiler report.
My question is, which DQS table store the this Profiler summary report where by I can automate the report through that source.
Here is the screenshot of the report we are looking at, we need to find out which DQS source table got this information.
Thanks for the help0
Hi All,
I have utilized the DQS for my organization Data Cleansing project. And we have built Data Quality reports using DQ output.
We also use Profiler Summary report in the Activity Monitor, but this is manual process where Data owners need to manually enter into the Activity monitor and generet the porofiler report.
My question is, which DQS table store the this Profiler summary report where by I can automate the report through that source.
Here is the screenshot of the report we are looking at, we need to find out which DQS source table got this information.
Thanks for the help -
Post Author: Hexagram16
CA Forum: Data Quality and Data Insight
Hi Guys,
Im new in data quality module, need some help, how to upload or update Data Quality Licenses? can anyone here give a blow by blow procedure?
Thanks in Advance.Are you referring to Data Quality XI or Data Insight?
Also what version? -
DATA QUALITY connection on INGRES
Post Author: ryefrancis
CA Forum: Data Quality and Data Insight
Hi,
Would like to ask if any you guys have any idea on the error prompt "NO COLUMNS SHOULD BE RETRIEVED FOR THIS TABLE. A POSSIBLE REASON IS THAT YOU DO NOT HAVE SELECT PERMISSION FOR THIS TABLE OR DATABASE"?
The database being used is INGRES. We already tried to update its
security settings and Grant Access still it won't establish a
connection.
But when we try using SQL statements instead of SQL HELPER we could get some reports.
Hope you could have any suggestions and solutions to this problem.
Good Day!!!Ingres is not supported for Data Insight however if you will send some additional information we may be able to check if anything obvious is missing.
Two items that may help are the connection information from the Data Insight repository (iqi_connection table) for this source and screen shots of the populated connection dialogs. -
Data Quality - Failed to create connection to MDR.
Hi All,
I have installed Data Quality 11.7.2 on windows 2003 server using SQL 2005 (Both SQL 2005 server and Data Quality are in the same server) , The install was successful. But when I try to Open 'Data Quality Project Architect' it throws an error
Failed to create connection to MDR.
Driver error messgage = qodbc_mssql:
Unable to connect, Database error message =] [microsoft][odbc sql server driver]
[ tcp/ip sockets] sql server does not exist or access denied
I checked the ODBC connection and tested it successfully too.
I am not able to pass through the 'Meta Data Repository Connection' as its failing in 'Setup SQL connection option'
Any help is appreciated !!!
Thanks
Ranjit KrishnanHi Paul,
Thanks for you reply, OBDC connection was created under System DSN, also tired the users DSN option too, but did not work.
Recreated the ODBC connection many times still no luck.
The 'Project Architect' client and the MDR (SQL 2005 Server) are on the same machine.
Thanks
Ranjit Krishnan -
Data Quality Services - Summary report
Hi,
Is anyone has a idea about which table is stored summary information comming out from Activity monitor?
the example is below:
when I exported the data the summary as follows:
My pourpose is to automate this report if it is stored on DQS data bases?
Field
Domain
Corrected Values
Suggested Values
Completeness
Accuracy
EmployeeName
EmpName
5 (0.06%)
0 (0%)
7303 (88.73%)
8222 (99.89%)
EmployeeKey
EmployeeKey
1 (0.01%)
0 (0%)
8231 (100%)
8215 (99.81%)
CostCentreKey
CostCentreKey
0 (0%)
0 (0%)
8231 (100%)
8141 (98.91%)
CostGroupKey
CostCentreGroupKey
0 (0%)
0 (0%)
7188 (87.33%)
7094 (86.19%)
LeaveGroupKey
LeaveGroupKey
0 (0%)
0 (0%)
8231 (100%)
8129 (98.76%)
EmployeeStatusKey
EmployeeStatusKey
0 (0%)
0 (0%)
8231 (100%)
8212 (99.77%)
EmployeePositionNumber
EmployeePositionNumber
0 (0%)
0 (0%)
8214 (99.79%)
8117 (98.61%)
EmployeeEmail
EmployeeEmail
0 (0%)
0 (0%)
5133 (62.36%)
8220 (99.87%)
HoursPerWeek
HoursPerWeek
0 (0%)
0 (0%)
8214 (99.79%)
8213 (99.78%)
Gender
Gender
0 (0%)
0 (0%)
8231 (100%)
8231 (100%)
EmployeeEFT
EmployeeEFT
0 (0%)
0 (0%)
8214 (99.79%)
8213 (99.78%)
EmployeePostCode
EmployeePostCode
0 (0%)
0 (0%)
8153 (99.05%)
8124 (98.7%)
EmployeeSuburb
EmployeeSuburb
133 (1.62%)
0 (0%)
8152 (99.04%)
8134 (98.82%)
ReportToManager
ReportToManager
0 (0%)
0 (0%)
7037 (85.49%)
7036 (85.48%)
PositionClassificationCode
PositionClassificationCode
0 (0%)
0 (0%)
8144 (98.94%)
8144 (98.94%)
PositionClassificationDesc
PositionClassificationDesc
0 (0%)
0 (0%)
8144 (98.94%)
8144 (98.94%)
PositionLocation
PositionLocation
0 (0%)
0 (0%)
8214 (99.79%)
8122 (98.68%)
Age
Age
0 (0%)
0 (0%)
8231 (100%)
8229 (99.98%)
CurrentClassCode
CurrentClassCode
0 (0%)
0 (0%)
7908 (96.08%)
7906 (96.05%)
CurrentCLassDescription
CurrentCLassDescription
0 (0%)
0 (0%)
7908 (96.08%)
7907 (96.06%)
EmpState
EmpState
0 (0%)
0 (0%)
8153 (99.05%)
8137 (98.86%)0
Hi All,
I have utilized the DQS for my organization Data Cleansing project. And we have built Data Quality reports using DQ output.
We also use Profiler Summary report in the Activity Monitor, but this is manual process where Data owners need to manually enter into the Activity monitor and generet the porofiler report.
My question is, which DQS table store the this Profiler summary report where by I can automate the report through that source.
Here is the screenshot of the report we are looking at, we need to find out which DQS source table got this information.
Thanks for the help -
Data Quality for name and address
Hello,
We have OWB10G and would like to use Name and Address operator. It seesm to me that we need to buy some Data Quality library from some 3rd party ( FirstLogic etc). Our client is not ready to pay money to buy these 3rd party libraries. How would we go and still be able to use Name and address operator.
I was in the impression that OWB has some builtin Data Quality libraries. Do we have to write some PL/SQL to clean , parse , match and merge data or it can be done using OWB? Why OWB does not have these libraries built-in.
Is there some freely available Data Quality tool?
Thanks
Suhail Ahmadbump again,
Oracle used to have pure extraxt and integrate, could we use these libraries with OWB10G?
Syed -
Data Quality , Name and address
I would like to know if someone has used Name and address functinality in OWB. I would like to clean our data and possibly link two or more record with one record and also would like to standardise the addresses such as Parkway to Pkwa, st. to street etc. Is this all possible in OWB? Could I use Name and address server to do all these?
While reading a FAQ on http://otn.oracle.com/products/warehouse/htdocs/ORACLE92_WAREHOUSE_BUILDER_DQ_FAQ.htm , it seems to me that I need to buy some kind of data qulaity software from third party, am I right?
Thanks
SuhailSyed,
Many OWB customers are using OWB's Name and Address, and Match-Merge capabilities to perform the tasks you described.
You are right, as the Data Quality FAQ states, Name and Address, while modelled in OWB at design time, requires third-party software at the run-time. That software is licensed separately (directly with third-party vendors, previously Oracle re-sold the third-party technology as an extra option to OWB). However, Match-Merge does not rely on any third-party technology.
There are introductory viewlets and self-paced exercises for both of these features at http://otn.oracle.com/products/warehouse/htdocs/OTN_viewlet.html
Nikolai -
Data Quality Admin and Client on Windows 7 Issue
Hi,
I am experiencing a strange behaviour of Data Quality two shortcuts referring to admin.exe and discovery.exe .
I get the program running only if I right click on the original installed shortcut (running as administrator). The will not work neither if the shortcut is copied anywhere else nor if the shortcut is got from the start menu after a search in the bottom box. The problem seems related to the compatibility. If I do not launch the binaries using the "troubleshoot compatiibilty" also the binary itself will not start.
Tried to save the settings to run in XP compatibility mode but this is not honored.
Someone else fixed this?
Thanks
Fabio D'Alfonso/* Style Definitions */
table.MsoNormalTable
{mso-style-name:"Table Normal";
mso-tstyle-rowband-size:0;
mso-tstyle-colband-size:0;
mso-style-noshow:yes;
mso-style-priority:99;
mso-style-qformat:yes;
mso-style-parent:"";
mso-padding-alt:0in 5.4pt 0in 5.4pt;
mso-para-margin:0in;
mso-para-margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:10.0pt;
font-family:"Times New Roman","serif";}
The quickest solution might be to try to reinstall followed by another uninstall, or to use the Windows Install Cleanup Utility, (although Microsoft has removed it from their support site with the following disclaimer).
Notice
This article previously contained a link to the Windows Installer Cleanup utility (MSICUU2.exe). If you were directed to this article to solve a problem installing a product other than Microsoft Office, please contact your software manufacturer for installation support on the product.
While the Windows Installer Cleanup utility resolved some installation problems, it sometimes damaged other components installed on the computer. Because of this, the tool has been removed from the Microsoft Download Center.
Nonetheless, here is an active link and basic instructions:
http://majorgeeks.com/download.php?det=4459
1. To use the Windows CleanUp utility, follow these steps:
a. Click Start, point to Programs, and then click Windows Install Clean Up.
b. Select the program that you want to remove, and then click Remove.
c. Click OK, and then click Exit.
If these suggestions do not help, then perhaps a case should be opended with TAC and they could assist with gathering the installer log files.
-ken -
Data integrator for HP-UX missing data quality and data profiling
Hi All,
I have installed ODI 10.1.3.40.0 from odi_unix_generic_10.1.3.4.0.zip in HP unix 11.23.
Data quality and data profiling is missing in that zip ? Could anyone please help me how to get installer of data quality and data profiling for Oracle data integrator in HP UX 11.23.
Any response will be highly appreciated.
Thanks in advance.
regards
Umapada
Edited by: user10612738 on Nov 28, 2008 1:54 AMThe integrated packaged( ODi, data quality and data profiling) for HP-UX wount available till 10.1.3.5.0 which will be released by this year end.
-
Data quality and error messages during transformation
I've read [Maintaining Data Quality in BW using Error Stack|http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/20ebeb43-9e8a-2d10-b28e-825c0142ad4f] with great interest and hope this will become standard in the company, right now we have too many complex transformations which have been developed without logging and messaging.
One thing is unclear, the error message described in the example
monitor_rec-msgid = 'ZMESSAGE'
seems to refer to a ZMESSAGE defined in another step.
Could you please tell me how (transaction?) to define this message to be called during transformation?
Thanks in advancese91
-
In DS 12.1.1.0,
when I try to open a Data Quality Report in the Management Console I get a new Windows with the following error message:
Fehler
Fehler bei der Seitenformatierung: FormulaFunction hat eine unerwartete Ausnahme von der 'evaluate'-Methode ausgelöst.
Tomcat log stdout says:
19-05-09 10:58:59:708 - {ERROR} sdk.JRCCommunicationAdapter Thread [http-28080-Processor24]; JRCAgent5 detected an exception: Fehler bei der Seitenformatierung: FormulaFunction hat eine unerwartete Ausnahme von der 'evaluate'-Methode ausgelöst.
at com.crystaldecisions.sdk.occa.report.lib.ReportSDKException.throwReportSDKException(Unknown Source)
at com.businessobjects.reports.sdk.b.i.byte(Unknown Source)
at com.businessobjects.reports.sdk.JRCCommunicationAdapter.request(Unknown Source)
at com.crystaldecisions.proxy.remoteagent.y.a(Unknown Source)
at com.crystaldecisions.proxy.remoteagent.r.a(Unknown Source)
at com.crystaldecisions.sdk.occa.report.application.cf.a(Unknown Source)
at com.crystaldecisions.sdk.occa.report.application.ReportSource.a(Unknown Source)
at com.crystaldecisions.sdk.occa.report.application.ReportSource.getPage(Unknown Source)
at com.crystaldecisions.sdk.occa.report.application.AdvancedReportSource.getPage(Unknown Source)
at com.crystaldecisions.sdk.occa.report.application.NonDCPAdvancedReportSource.getPage(Unknown Source)
at com.crystaldecisions.report.web.event.ac.a(Unknown Source)
at com.crystaldecisions.report.web.event.ac.a(Unknown Source)
at com.crystaldecisions.report.web.event.b2.a(Unknown Source)
at com.crystaldecisions.report.web.event.b7.broadcast(Unknown Source)
at com.crystaldecisions.report.web.event.av.a(Unknown Source)
at com.crystaldecisions.report.web.WorkflowController.do(Unknown Source)
at com.crystaldecisions.report.web.WorkflowController.doLifecycle(Unknown Source)
at com.crystaldecisions.report.web.ServerControl.a(Unknown Source)
at com.crystaldecisions.report.web.ServerControl.processHttpRequest(Unknown Source)
at org.apache.jsp.jsp.dqcrystalviewer_jsp._jspService(dqcrystalviewer_jsp.java:274)
at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:334)
at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:672)
at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:463)
at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:398)
at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:301)
at org.apache.struts.action.RequestProcessor.doForward(RequestProcessor.java:1063)
at org.apache.struts.action.RequestProcessor.processForwardConfig(RequestProcessor.java:386)
at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:229)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1194)
at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:414)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at com.acta.webapp.mdreport.servlet.JSFilter.doFilter(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)
Any idea how this can happen?
Regards,
Martin
Edited by: Martin Bernhardt on May 19, 2009 11:03 AMMartin,
can you try to change the Settings of your Internet Explorer:
Tools --> Internet Options --> General/Appearance/Languages
Add "English (United States) [en-US]" and move it to first place above the "German (Germany) [de]" entry?
Niels -
Data quality report under management consol
I am using BO DS 4. and trying to use the data quality report under management consol. For me these reports are getting generated for every run of the address cleanse Job.
Is it possible to get a consolidated report for a day of the Job rather then for each run? If yes, please let me know how I can do that.Please respond, If any body has any clue on this
Maybe you are looking for
-
Install downloaded software other than on C: drive
I purchased this morning and downloaded the latest 64 bit version of Elements and Premiere to my E: drive (C: drive has Windows Ultimate 7 64 bit only). I have six files downloaded - one Application file and 7zArchive file set each for Photoshop Elem
-
Everytime I use iTunes, the process "apple mobile device helper" opens as well and takes up 15 MB of RAM (on top of the 50+ iTunes already uses). Is there a way to stop this from happening? I don't have any apple mobile device and I've disabled the p
-
this is what I'm getting driving me NUTS This page delivered to you by a web browser extension Click here to learn more.
-
Illustrator crashing since update -
I am running Illistrator CC and after an auto update the program has become so unstable that I can no longer work with it. If i select diferent menu items, such as New, Preference, Workspace -- it will crash. It was working perfectly for the first co
-
Help with Flash Player 10 download?? Nothing is working??
Hi everyone, I'm hoping someone can help me, because I'm going crazy about this. So I'm trying to download flash player 10. It says I have successfully downloaded it, but I get no animation, and on youtube it tells me I need the latest flash player