Can I filter the table being profiled in the Data Profiling task, or know of a work around? SSIS2008r2

Hi,
I import several files into a staging table. Inside a foreach loop, after the data flow task I have a Data Profiling task that profiles the table so we can give feedback to those who sent us the file.
I just relalized that after the first loop, there is more than one file in the staging table, hence more than one file is being profiled.
At first glance it doesnt appear I can add a "Where" clause to the table. I do have a column that states which file the data came from, but with only being able to profile a view or table, I can't filter.
Anyone have any ideas?
Mike

Catching outliers seeing how much of what kind of data exist, deviations, distribution, you get some sort of a historgram in essence with the Data Profiling.
It is normally a preamble to doing data ingress (or egress) into a new target.
Now patterns are in Fuzzy Lookups/matching or grouping. Having RegEx used is hard in SSIS! I admit, I proposed to have it included into SSIS VNext. I remember there was a component or two on CodePlex:
http://ssisctc.codeplex.com/ see if any makes sense, I recall I tried one just out for fun.
Arthur My Blog

Similar Messages

Can not filter the data with the extended class

Hi,
I have a quick question about PortableObject format. I have created a class which extends PortableObject interface and implemented serializer methods as well. I have updated it in the pof-config.xml file as well. If I insert the objects of this type of object in the cache, they get inserted properly and I can filter the values based on the getters defined in the class. Everything works fine here.
Now, I am trying to extend the existing class that I have. We have our custom API which we have built for our domain objects. I need to store these objects in the cache. So, naturally I need to implement PortableObject interface to do that. So, instead of creating a new class with new set of getters and setters and local fields, I am extending our domain class to create a new class which implements PortableObject interface. Instead of defining the local fields and getters and setters i am reusing the ones provided by my existing class. Now, I can insert the objects of the new class to the cache. But I can not filter the values for the objects of this new class.
Let me show you what exactly I am trying to achieve by giving a small example:
Domain Class:
class Person
private String person_name;
*public String getPerson_name() {return person_name;}*
*public String setPerson_name(person_name) {this.person_name = person_name;}*
The new class implementing PortableObject interface:
class ExtPerson extends Person implements PortableObject
public static final PERSON_NAME = 0;
*public void readExternal(PofReader reader) throws IOException{*
setPerson_name(reader.readString(PERSON_NAME));
*public void writeExternal(PofWriter writer) throws IOException{*
writer.writeString(PERSON_NAME, getPerson_name());
*// And HashCode, Equals and ToString methods, all implemented using the getter from the Person class*
So, if I create a new class ExtPerson without extending the Person class and write all the methods, store the objects in the cache and perform the following query, I get the size printed
System.out.println((cache.entrySet(new EqualsFilter("getPerson_name","ABC"))).size());
But if I use the extended class and insert the values into the cache and if I use the same query to filter, I get 0 printed on the console.
System.out.println((cache.entrySet(new EqualsFilter("getPerson_name","ABC"))).size());
So, can anyone tell what exactly is causing this?
Thanks!

Well, just a quick question. It seems that I can not get ContainsAnyFilter or ContainsAllFilter working.
EqualsFilter is actually working properly.
I am preparing a Set of Strings and passing it to ContainsAnyFilter or ContainsAllFilter and it is returning me 0 records.
E.g.:
Set<String> setStr = new HashSet<String>();
setStr.add("ABC");
setStr.add("DEF");
System.out.println((cache2.entrySet(new ContainsAnyFilter("getPerson_name", setStr))).size());
I get 0 in my output
If I try this:
System.out.println((cache.entrySet(new EqualsFilter("getPerson_name","ABC"))).size());
System.out.println((cache.entrySet(new EqualsFilter("getPerson_name","DEF"))).size());
I get 1 for each of the query.
If I club all these EqualsFilter in a Filter[] array and create an AnyFilter or AllFilter and pass it to the query, it works fine.
List<Object> lst = new ArrayList<Object>();
          lst.add("ABC");
          lst.add("DEF");
Filter[] filter = new Filter[lst.size()];
     for(int i=0;i<lst.size();i++)
          filter[i] = new EqualsFilter("getPerson_name",lst.get(i).toString());
AnyFilter fil = new AnyFilter(filter);
System.out.println((cache4.entrySet(fil)).size());
I get the desired result here, which is 2.
Am I missing something here?

How can I filter a table from Data Control without enter query

I have a table from a web service data control based on WSDL.
I want to filter the table without input query at filter text box. Without filter text box, each would filter the table with a hardcoded query internally.
For example, when user click A menu button then it filters the table where type = '1' and B menu button filters the table by type='2' and C menu button filters the table by type=' ' .
How can I filter the table without enter query?
Could anyone point me to a solution please.
Thanks.
jdev 11.1.5
Edited by: 893364 on Oct 26, 2011 12:15 PM
Edited by: 893364 on Oct 26, 2011 12:21 PM

Hi,
when you created the table, did you try selecting the "filter" option. Select the table and go to the Property Inspctor. In the tool bar of the Property Inspector there is an icon to change the configuration. Its adding filter filter fields for the user to search in.
Option 2: The data of the Web Service actually is held in the iterators. If you wanted to filter the WebService query, I would not use the WS DC but a JAX-WS proxy in a POJO to fetch the WS Data. Then have the Data Control created from the POJO. You could have a method exposed on the POJO that allows you to filter the internally held data
Frank

Can anyone confirm the date used for pushing the data into AR interface table? Is it abse don Actual ship date or scheduled ship date?

Can anyone confirm the date used for pushing the data into AR interface table? Is it abse don Actual ship date or scheduled ship date? We are facing a scenario where trx date is lower than the actual ship to which logically sounds incorrect.
Appreciate any quick response around this.

Hi,
Transaction date will be your autoinvoice master program submission level date (If you haven't setup any logic.
Please check the program level default date, if user enter old date ststem will pick the same.
Customer is trying to set the value of the profile OM:Set receivables transaction date as current date for non-shippable lines at the responsiblity level. System does not set the transaction date to current date in ra_interface_lines_all.
CAUSE
Customer has used the functionality in R11i. But after the upgrade to R12, the system functions differently than R11i.
SOLUTION
1.Ensure that there are no scheduled workflow background process run.
2.Set the profile "OM: Set Receivables Transaction Date as Current Date for Non-Shippable Lines" at Responsibility level only as Yes.
3.Now switch the responsibility to which the profile is set.
4.Create order for Non-Shippable Lines and progress it to invoicing.
5.Ensure that the 'workflow background process' concurrent program is run in the same responsibility and this line is considered in it.
6.Now check if the 'SHIP_DATE_ACTUAL' is populated to ra_interface_lines_all

How can we delete the data in e-fact table.

how can we delete the data in e-fact table.

hii,
You cannot delete the request individually but you can one of the following:
1. Do a selective deletion from the cube. RSA1 -> Cube -> Contents -> selective deletion.
2. Delete all the data in the cube and then reconstruct only the required request ids. This would work only if you have the PSA available for all the requests.
3. Reverse posting is another possibility.
hope it helps,
partha

How can I change the date format in a Numbers table?

I have selected all of the cells in a date column, opened the Inspector and selected the Date & Time format, selected the date & month format butb the cell date does not conform to this format. Instead I am getting the month, day, year, and time.
Stu

Stu,
In order for Numbers to format the date it must already be a valid date. If you post a screenshot we can see that the dat is valid.
Make sure after you enter the date that the date ends up being right justified AUTOMATICALLY. If the date is NOT valid, Numbers interprets it simply as text which it leaves left justified

How can i convert the data from mutiple-table to the other database(MSSQL)?

Dears,
How can i convert the data from mutiple-table to the other database such as MS-SQL?
I have a third party system based on MS-SQL 2000.
Now we want to make a integration between SAP R/3(Oracle) and SQL server.
When my user releases the purchase order in R/3, the application we coded will convert the releated data to the temp database on the SQL server.
But i don't know which tools will help me reach the purpose. BAPI, LSMW, IDoc... ???
Would anybody tell me which way is better and how to do?
Thanks a lot!
Kevin Wang

Hello Kevin,
The question to use which method depend on your detail requirements. If you use BAPI, you need to find which Bapi can provide the data you want. Bapi normally use as a function called by external system. So you need to develop an external program like VB/Java to call this Bapi and move it to SQL. LSMW is use when you want to upload data from an external system to SAP. So it does not serve your requirement. Idoc can be use to export data to an external system. Again like Bapi, you need to find what Idoc can provide the data you want. However, it does not any programming from the external system. If I were you, based on your requirements, I think writing an Abap program that read the data you want and download it to NT/SQL server will be faster and easier.

How can I set the data binding between Web Dynpro & Database table

Dear friend,
I am a beginner of Web Dynpro. I want to develop my simple project like these:
1. Create my own database table via Dictionary Project such as TAB_USER and have 3 fields: USER_ID, USER_NAME, USER_POSITION and I have already deployed & archived it.
2. Create my own Web Dynpro Project, and create the input fields as User ID, User name, User position and icon 'Save' on the selection screen and I have deployed it already.
For the process, I want to input data at the screen and save the data in the table, please give me the guide line like these:
1. How can I set the data binding between Web Dynpro and Database table ?
2. Are there any nescessary steps that I will concern for this case?
Sorry if my question is simple, I had try to find solution myself, but it not found
Thanks in advances,
SeMs

Hi,
You can write your own connection class for establishing the connection with DB.
Ex:
public class ConnectionClass {
static Connection con = null;
public static Connection getConnection() {
try{
Context ctx = new InitialContext();
DataSource ds = (DataSource) ctx.lookup("jdbc/TSPAGE");
con = ds.getConnection();
return con;
}catch(Exception e){
return null;
You can place the above class file in src folder and you can use this class in webdynpro.
You can have another UserInfo class for reading and writing the data into the DB .
Regards, Anilkumar
PS : Refer
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/com.sap.km.cm.docs/library/webas/java/simple java bean generator for database.pdf
Message was edited by: Anilkumar Vippagunta

How can i export the data to excel which has 2 tables with same number of columns & column names?

Hi everyone, again landed up with a problem.
After trying a lot to do it myself, finally decided to post here..
I have created a form in form builder 6i, in which on clicking a button the data gets exported to excel sheet.
It is working fine with a single table. The problem now is that i am unable to do the same with 2 tables.
Because both the tables have same number of columns & column names.
Below are 2 tables with column names:
Table-1 (MONTHLY_PART_1)
Table-2 (MONTHLY_PART_2)
SL_NO
SL_NO
COMP
COMP
DUE_DATE
DUE_DATE
U-1
U-1
U-2
U-2
U-4
U-4
U-20
U-20
U-25
U-25
Since both the tables have same column names, I'm getting the following error :
Error 402 at line 103, column 4
alias required in SELECT list of cursor to avoid duplicate column names.
So How can i export the data to excel which has 2 tables with same number of columns & column names?
Should i paste the code? Should i post this query in 'SQL and PL/SQL' Forum?
Help me with this please.
Thank You.

You'll have to *alias* your columns, not prefix it with the table names:
$[CHE_TEST@asterix1_impl] r
1 declare
2    cursor cData is
3      with data as (
4        select 1 id, 'test1' val1, 'a' val2 from dual
5        union all
6        select 1 id, '1test' val1, 'b' val2 from dual
7        union all
8        select 2 id, 'test2' val1, 'a' val2 from dual
9        union all
10        select 2 id, '2test' val1, 'b' val2 from dual
11      )
12      select a.id, b.id, a.val1, b.val1, a.val2, b.val2
13      from data a, data b
14      where a.id = b.id
15      and a.val2 = 'a'
16      and b.val2 = 'b';
17 begin
18    for rData in cData loop
19      null;
20    end loop;
21* end;
for rData in cData loop
ERROR at line 18:
ORA-06550: line 18, column 3:
PLS-00402: alias required in SELECT list of cursor to avoid duplicate column names
ORA-06550: line 18, column 3:
PL/SQL: Statement ignored
$[CHE_TEST@asterix1_impl] r
1 declare
2    cursor cData is
3      with data as (
4        select 1 id, 'test1' val1, 'a' val2 from dual
5        union all
6        select 1 id, '1test' val1, 'b' val2 from dual
7        union all
8        select 2 id, 'test2' val1, 'a' val2 from dual
9        union all
10        select 2 id, '2test' val1, 'b' val2 from dual
11      )
12      select a.id a_id, b.id b_id, a.val1 a_val1, b.val1 b_val1, a.val2 a_val2, b.val2 b_val2
13      from data a, data b
14      where a.id = b.id
15      and a.val2 = 'a'
16      and b.val2 = 'b';
17 begin
18    for rData in cData loop
19      null;
20    end loop;
21* end;
PL/SQL procedure successfully completed.
cheers

FAQ: Can I filter the photos to show just those taken by someone, or liked, or commented on?

FAQ: Can I filter the photos to show just those taken by someone, or liked, or commented on?
Answer:
Yes, GroupPix can show you just subsets of photos at a time.
To see just the photos from a particular person,
iOS: go into full screen view for a photo, then tap that person's name; you will see a grid showing only those photos contributed by that person.
Android: go into an event, select the menu under the Event name, and tap 'Photographer' to show a list of contributors to an event. Tap a person to see their photos.
To see photos that are liked or have comments, tap the Filter button in the upper-left of the screen. Then, choose just Liked Photos or Commented Photos.
Tap the back arrow to return to full the Group Album.

FAQ: Can I filter the photos to show just those taken by someone, or liked, or commented on?
Answer:
Yes, GroupPix can show you just subsets of photos at a time.
To see just the photos from a particular person,
iOS: go into full screen view for a photo, then tap that person's name; you will see a grid showing only those photos contributed by that person.
Android: go into an event, select the menu under the Event name, and tap 'Photographer' to show a list of contributors to an event. Tap a person to see their photos.
To see photos that are liked or have comments, tap the Filter button in the upper-left of the screen. Then, choose just Liked Photos or Commented Photos.
Tap the back arrow to return to full the Group Album.

Can we Filter the records using ROW_NUMBER() funtion?

Oracle 10G
Hi all,
In the below query i used ROW_NUMBER() function to get the rownum value after descending order the results.
How Can i filter the first 10 rows without using a subquery?
I tried to use alias names but it doesn't work. Is there a way or it should be done only with subqueries?
select article_type_id,
article_type_desc,
ROW_NUMBER() OVER ( order by article_type_id desc) rnum
from s_article_types
Results are
ARTICLE_TYPE_ID     ARTICLE_TYPE_DESC     RNUM
37     Non-Degree News     1
36     Career News     2
35     ET News     3
34     Hotcourses 2.0 General     4
33     Hotcourses 2.0 Permanent     5
32     Hotcourses 2.0 News     6
1 General news 37
Thanks in advance

You can do
select * from
select article_type_id,
article_type_desc,
ROW_NUMBER() OVER ( order by article_type_id desc) rnum
from s_article_types
where rnum <= 10You can't do it direct.

I saw a post on how to load iMovie 6 without deleting iMovie 9 or iLife 11 I can't find the post now does anyone know if this is possible. I do not want risk not being able to reload iMovie 9 it appears that I would have to reload the whole iLife suit

I saw a post on how to load iMovie 6 without deleting iMovie 9 or iLife 11 I can't find the post now does anyone know if this is possible. I do not want risk not being able to reload iMovie 9 it appears that I would have to reload the whole iLife suit

Could have been mine!
Happily this is easily achieved, but it has to be done backwards.
Delete iMovie 9 (just drag it to the trash). Now install iMovie 6 from the iLife 6 install disks.
Now re-install iMovie 9. This automatically moves iMovie 6 into a folder it creates in your Applications folder called iMovie Previous Version.
Now you have them both, and you can have both in the Dock as well.
Alternatively you could try this method, suggested by poster Uitech:
Open a terminal and type "touch /Library/Preferences/com.apple.iLife08.plist"
(No quotes)
Install iMovieHD6 from the iLife 6 install disk.
This works with both Leopard and Snow Leopard Macs.

How can I display the data in table in separate column?

I have a vi reading data one by one in the same column.
How can I display the data with separate column?
like this:
data 1 | read | read
data 2 | read | read
data 3 | read | read
(would you mind if I will ask for an example
because it is much easier for me to work
with an example)
THANK YOU.

If you're reading your data in as a 1D array, this is as simple as using the Reshape Array to make a 2D array. I've attached an example in LabVIEW 6.1 format. The example rearranges a single column of data fill several columns horizontally, but you can easily modify this code to fill the columns downward instead.
Attachments:
Data_Column_Example.vi ‏18 KB

How to filter the data in different sections (e.g. Report Footers)?

Hi,
I am using Crystal Reports 11 to generate cross-tables.
I plan to generate 3 cross-tabs, and each cross-table will be put in a section. For example, cross-tab1 in Report Footer a; cross-tab2 in Report Footer b; cross-tab3 in Report Footer c.
I know use "Select Expert" to filter data. But, it seems that "Select Expert" filters data for the whole report.
I want to filter the data for each cross-table separately. For example, filter cross-tab1 based on condition1; filter cross-tab2 based on condition2; filter cross-tab3 based on condition3.
How to filter the data in different sections (e.g. Report Footers)?
Thank you in advance.

Hi,
Now that you've inserted the subreport just right-click the sub-report and click Edit. The Design page for sub-report should open up.
You can now insert the cross-tab on the Report Header and insert a record selection formula of your choice.
Also, suppress all the other sections of the subreport so the Main report only shows the crosstab without any spaces.
Do the same for all the subreports.
-Abhilash

How to filter the data on Reports from collected from differnet Agents

1) I have to write a Plug-in which would fetch the same type of data from 7 Agents. I need to generate the report for each Agent separately,This plug-in will be deployed in various different environment. So I will not know the host name as it will be deployed different environment. Can anyone suggest how to filter the data for each agent from the table. I see one solution of using Bind variable for the Target GUID in PL/SQL file. Can you please suggest if there is any other better way of doing this.????
Also Can you please suggest what are the best ways to debug the OEM Plug-in?
Thanks Anyway.....

What I mean filtering data means displaying data for each Agent Seperatly. Assume I have collected Filesystem data from 5 Agents (5 different server). Now I want do display file system data for Agent1 (server 1). How would I fetch it from MGMT$Metric_Current. Currently I use a bind variable
??EMIP_BIND_TARGET_GUID?? to filter the data for a Agent from MGMT$Metric_Current view. I compare Target Name entered while deploying Plug-in with the Target_Name column of specified view.Is there any other way of fetching data from this table for a Agent?
I hope I am prety clear now. My Problem is IO dont want to force user to enter exact Server name while deploying Plug-in.
Thanks......

Can I filter the table being profiled in the Data Profiling task, or know of a work around? SSIS2008r2

Similar Messages

Maybe you are looking for