FIM Reporting alternative

Hi,
So we are aware of the FIM Reporting option using SCSM & SCDW. Do we need to use System Centre?
I am not really that clued up on SC or SQL ...so what are other alternatives if we need
1) FIM Reporting
2) Long term storage of records for audit purposes (and report on these)
Thx
SK

SCSM and SCDW are products within the System Centre suite itself, and you need both of those to enable FIM reporting. I'm not sure if you can license just those two products by themselves (although I suspect you should be able to) without getting the entire
System Center Suite (which has a lot more stuff in it)
FIM uses SQL to store everything, so in theory you always have the entire history and all the data in SQL. FIM Reporting just makes it easier by pulling out this data and presenting in a format you can easily query and customise.
This is purely my opinion, but FIM reporting is quite a heavy component and can be tricky to setup. I know there is a third party plugin which can do a better job, just can't remember the name of it!
There's a great blog about FIM reporting you might want to read
http://blog.predica.pl/fim-reporting-architecture-overview/

Similar Messages

FIM Reporting and SCSM Database Query Issue

Hello,
We have been having issues with FIM Reporting, the ETL Process for some reason seems to be failing, we further drilled down and found that there was a SQL Query running on the SCSM database Server for a very long time.
"CREATE PROCEDURE dbo.[p_GroomManagedEntity] ( @TargetId uniqueidentifier, @RetentionPeriodInMinutes int, @GroomingCriteria nvarchar(max), @BatchSize int )
AS BEGIN DECLARE @LastErr int; DECLARE @RowCount int = 1; DECLARE @TotalRowCount int = 0; DECLARE @RetentionDateTime DATETIME; DECLARE @SelectEntitiesToBeGroomedStmt
nvarchar(max); DECLARE @CoreDeleteTypedEntitiesTable TypedManagedEntityType; DECLARE @TimeGenerated DATETIME = getutcdate(); DECLARE @Command nvarchar(MAX) DECLARE @GroomHistoryId
bigint DECLARE @Comment nvarchar(max); SET @Command = N'Exec dbo.p_GroomManagedEntity ' + CAST(@TargetId AS nvarchar(40)) + ', ' + CAST(@RetentionPeriodInMinutes AS nvarchar(10)) +
', ' + CAST(@GroomingCriteria AS nvarchar(100)) + ', ' + CAST(@BatchSize AS nvarchar(10)) -- Call the grooming history insert sproc EXEC @LastErr = dbo.p_InternalJobHistoryInsert @Command,
@GroomHistoryId OUT IF @LastErr <> 0 GOTO Err; CREATE TABLE #BaseManagedEntitiesToDelete ( BaseManagedEntityId uniqueidentifier
); -- Figure out the retention datetime SELECT @RetentionDateTime = DATEADD(mi, -@RetentionPeriodInMinutes, getutcdate()) -- Execute the grooming filter statement,
hence populate the table variable, with "BatchSize" many entities. WHILE (@RowCount > 0) BEGIN INSERT #BaseManagedEntitiesToDelete EXEC sp_executesql @GroomingCriteria,
N'@Retention DATETIME,@TargetTypeId uniqueidentifier,@NumOfEntities INT', @Retention = @RetentionDateTime, @TargetTypeId = @TargetId, @NumOfEntities = @BatchSize;
SELECT @LastErr = @@ERROR, @RowCount = @@ROWCOUNT; IF @LastErr <> 0 GOTO Err; IF (@RowCount >
0) BEGIN -- Convert the BMEIds to TMEIds. INSERT @CoreDeleteTypedEntitiesTable SELECT
TME.TypedManagedEntityId FROM #BaseManagedEntitiesToDelete D JOIN dbo.TypedManagedEntity TME ON D.BaseManagedEntityId
= TME.BaseManagedEntityId WHERE TME.IsDeleted = 0; SELECT @LastErr = @@ERROR;
IF @LastErr <> 0 GOTO Err; --
Use existing DDP code to delete the instances captured in the temp table. EXEC @LastErr = dbo.p_DDPWrapperForGroomManagedEntity @TimeGenerated, @CoreDeleteTypedEntitiesTable;
IF @LastErr <> 0 GOTO Err; TRUNCATE TABLE #BaseManagedEntitiesToDelete;
SELECT @LastErr = @@ERROR; IF @LastErr <> 0 GOTO Err; END
SET @TotalRowCount = @TotalRowCount + @RowCount; END -- Call the grooming history insert sproc to update status to success
SET @Comment = N'BaseManagedEntity: ' + CAST(@TotalRowCount AS nvarchar(10)) EXEC @LastErr = dbo.p_InternalJobHistoryUpdate @GroomHistoryId, 1, @Comment IF @LastErr <> 0
GOTO Err; RETURN 0 Err: -- Call the grooming history insert sproc to update status to failure. SET @Comment = N'BaseManagedEntity: ' + CAST(@TotalRowCount
AS nvarchar(10)) EXEC @LastErr = dbo.p_InternalJobHistoryUpdate @GroomHistoryId, 2, @Comment IF @LastErr <> 0 GOTO Err; RETURN 1 END"
Can somebody advise on what this query is really about and what is its fuction, we are thinking of killing this query since it has been running for a very long time, will that hamper or cause the database to corrupt.
Rgds,
Abhishek.

Vijay,
Thanks for you reply.
I figure out a related bug:
Bug 12859472: Cannot browse store procedure in case-sensitive MS SQL Database
There are two possible workarounds:
1. Use a database name with capital letters
2. Do not use stored procedures, but access the tables directly.
The notes on the Bug ticket describes that the issue would be scheduled to be fixed in PS7 which is 11.1.1.8.
Cheers!
Leandro.

FIM Reporting initial sync running long time

We have installed FIM Reporting last month , afterwards our FIM reporting initial sync powershell script is running from last month to Sync FIM data with SCSM server , but still only half data is synced with SCSM server ,
we have 4 server
1. Server1 --FIM server
2. Server2 -- FIM database
2. Server3 -- SCSM service manager and SQL server Databases for Service manager and Data warehouse
4. Server4 -- Data warehouse server
As FIM initial sync script is taking long time to sync so we found some errors in Server 4 (Data warehouse server) multiple times during ETL jobs running.
Error screen shot
Please give some suggestions to make FIM initial sync faster

Please try Resume-FIMReportingInitialSync instead of starting initial sync once again.
Sadly Initial Sync is very long and even on test environments it can take a long time.
But it seems that data from FIM was successfully moved to reporting database, but it hasn't been calculated by Service Manager correctly between its databases.
If you found my post helpful, please give it a Helpful vote. If it answered your question, remember to mark it as an Answer.

FIM Reporting ETLScript PowerShell Script for SCSM 2012?

Hi,
The FIM Reporting Deployment Guide is great, however on a few occasions it forgets to mention where you meant to execute things (http://technet.microsoft.com/en-us/library/jj133855(v=ws.10).aspx) .
For example, if it wasn't for the screenshot in the article, we would not have known that we need to run the ETLScript from the FIM Service/Portal server.
Everything until the ETLScript has thus far worked; and we have deployed the Service Manager 2012 console on the FIM Service/Portal server (since we are using SCSM 2012 for FIM Reporting).
However, it appears that the ETLScript (in the deployment guide) has been written for SCSM 2010.
So, has Microsoft or anyone published an updated SCSM 2012 ETLScript script?
Thanks,
SK

Could this be it?
http://gallery.technet.microsoft.com/PowerShell-Script-to-Run-a4a2081c

FIM reporting -- Run FIMPostInstallScirptsForDatawarehouse.ps1 script

We have 3 servers and
1. Server 1 -- FIM Service
2. Server 2 -- Service Manager server + Sql Server 2008 r2 with (ServiceManager DB on instance 1 +DWStagingAndConfig, DWRepository, and DWDataMart DB on instance 2)
3. Server 3 -- Data warehouse server
We have installed FIM reporting and MPSyncJob is successfully over. Next step is to run FIMPostInstallScirptsForDatawarehouse.ps1 on Data warehouse server but The FIM Reporting post installation scripts required to execute
.\FIMPostInstallScriptsForDataWarehouse.ps1
scripts in the Data Warehouse server. However, this script requires access to the "SQLCmd" tools and the "SMCmdletSnapIn" snapins. These two components are both present
when the SQL server resides in the Data Warehouse server. In this scenario that condition is not true. In this procedure, we will run the FIM post installation powershell script in the SQL server. We will create a PSSessionConfiguration in the Data Warehouse
server that will get called from the remote SQL server to execute the "SMCmdletSnapIn".
To run the script i was following the steps on this link social.technet.microsoft.com/wiki/contents/articles/17916.troubleshooting-fim-install-fim-data-warehouse-support-scripts-on-a-remote-sql-server.aspx
But in creating PSSession i am getting Access Denied error .
So is it possible, if i will install SQL server management studio on Data Warehouse server as i will get SQLCmdlets of powershell in Data Warehouse server so i can run the script directly on Data warehouse server without creating PSSession
Will it work ??

You can download just the needed pieces from
http://www.microsoft.com/en-us/download/details.aspx?id=16978.
Thanks, Brian
I think Brian wanted to paste the link without dot at the end ;)
http://www.microsoft.com/en-us/download/details.aspx?id=16978
If you found my post helpful, please give it a Helpful vote. If it answered your question, remember to mark it as an Answer.

FIM Reporting Resume-FIMReportingInitialSync too slow

I installed FIM Reporting services , and followed the document step by step.
I started the "Start-FIMReportingInitialSync" script , it ran for some time and stopped due to an error.The error reads
"The client has been disconnected from the server.Please call ManagementGroup.Reconnect() to reestablish the connection."
This issue as i understand might have occured due to a connectivity issue.
Hence i used the "Resume-FIMReportingInitialSync" to start the initial synce.but this script is too slow and even slower than the "Start-FIMReportingInitialSync".
Can anybody suggest how to speed up the Initial sync process.
Also, if anybody can tell me where are the data stored moved by the script "Start-FIMReportingInitialSync"
Regards
shakti

Any Update on the above issue.
shakti

FIM Reporting Services Port requirements

Hi ,
Can anybody let me know what are the communication ports required for deploying fim reporting services.
I am unable to complete the installation.any help would be greatly appreciated.
Regards
Dushyant singh

When using SCSM 2012 (SP1) you also have to install the analytic services on the instances. I can't remember exactly if it was on the DW or MS, but it would tell you during the installation of it.
And make sure your FIM version is at leat 4.1.3451, I went through a lot of pain with version 4.1.3419 en the
KB256143 error.
Find me on linkedin: http://nl.linkedin.com/in/tranet

FIM Reporting Services Installation Failed

Hi,
I am trying to install FIM Reporting Service in our environment. I have followed the technet guide for doing so.
But my installation is encountering problems and it fails and rolls back.
After some troubleshooting , i found that the installation fails because of intermittent connection between scsm console in FIM Service server and SCSM server.
Whenever the installation fails , the connection also fails between scsm console in FIM Service server and SCSM server and i am also not able to telnet port 5724 at that time.
But after some secs again the connection happens successfully and i am able to telnet.I have checked with network team in this regard.they have confirmed no issues in the network.
Please could anybody suggest any thing on this regard.Any help will be greatly appreciated.
shakti

Hi There,
Also the Account name and password have to be entered below for mappings:
Data Warehouse Action Account - is for the Data writer account.
Data Warehouse Report Deployment Account - is for the Data reader account
The one which is blacked out in the screenshot will be the main SCOM Action account.
So re enter the passwords carefully and accordingly and check and let me know.
Gautam.75801

Hardware capability for FIM Reporting

I am doing some capacity planning for a FIM 2010 R2 deployment and trying to understand the hardware requirements for the Reporting feature. Based on the diagarm below, it looks like the performance is primarily driven by two factors: System
Center and SQL. Even the performance of System Center depends on SQL. So it all comes down to SQL horsepower. The rest of the servers (FIM, SCSM, SCDW) may not need much muscle power (I might be wrong though). What is your experience when planning
for Reporting? What kind of challenges one can experience? Btw, I have a userbase of 100K and the change rate (# of requests per day) I am expecting is about 6%. What kind of hardware capacity would you recommend?
Thanks!

To start with, the picture is indeed really great … but it’s missing (or not emphasizing enough) one important component – SCSM’s Service Manager database.
As for the capacity question, we've seen the biggest impact/load on the SCCM databases, both Service Manager and Data Warehouse (mainly DWStagingAndConfig) – so yes, SQL is what
drives all that. Also, we haven’t tried SP1 yet, so what we observed was still on SCCM 2010.
Anyway, here are few pointers from our experience:
1. SCSM Service Manager DBs and Data Warehouse DBs should be installed on different SQL instances (has to do with the nature of the DBs) and preferably on different SQL servers.
And ideally separately from other FIM component DBs.
2. SCSM Service Manager DB can easily grow over twice the size of your FIMService DB (with indexes taking a lot of space), and it’s transaction log can quickly reach crazy sizes
especially during initial load. This is the experience from running it just for few months, it might change after longer usage.
3. From SCSM Data Warehouse DBs the only one you need to worry about is the DWStagingAndConfig. In our environment size wise it was comparable to FIM Service DB, but the observed
IO during ETL jobs was just crazy – I’ve seen graphs of it generating 300-400MB/s read IO on a 150GB DB for over 10h straight (with plenty of RAM on the SQL box).
4. Overall it seems like latency to the DB files is one of the main factors driving performance of FIM Reporting (not to mention IO) – even to a point where SAN storage might
not be the best option here. Like Tomasz wrote, we were looking at setting up both SCSM components on two dedicated physical servers with local SQL and DBs on SSD drives … but didn’t get that far yet.
When I’m writing about FIM Reporting performance I’m referring to a number of individual changes (queued in the ExportLog table in the FIM Service DB) that can be extracted from
FIM Service to Service Manager in an hour – initially we were able to process below 200k records per hour, and after several tweaks, SAN reconfiguration, etc, we were almost able to double it. There isn’t any average correlation between number of requests
and number of entries in the ExportLog table, it all depends on type of changes and how many are a part of individual requests. To just to give you an idea, we observed 20M records that were added over a 7 day period (avg 120k per hour), during which the only
activity on FIM Service were approximately 20k SSPR registrations – highly customized (with confirmation emails flying around and some custom attributes being set), but still just SSPR. As you can imagine, with that level of activity we needed to push the
processing rate way over what we were seeing as FIM Reporting was barely being able to catch up in real time.
I hope this will be at least a bit helpful
J.
Piotr
P.S. Oh, and by "we" I mean my previous company, I recently moved to Microsoft.

Installing FIM Reporting in FIM 2010 R2 with SP1

I tried to install the Reporting component. I have FIM 2010 R2 with SP1 and SCSM 2012. I get a error saying I have to install the KB2561430. This is apparently a hotfix for SCSM 2010 SP1. I thought that FIM R2 with SP1 supports SCSM 2012 as written:
FIM Reporting
Support for Windows Server 2012 has been added.
Support for SQL Server 2012 has been added.
Support for SCSM 2012 has been added.
http://technet.microsoft.com/en-us/library/jj863246(v=ws.10).aspx
Is there anything I need to install in the SCSM side?
I'm stuck here

Hi,
Even I am running into the same issue. And installing FIM 2010 R2 SP1 Reporting [SCSM 2012 successfully installed].
Both Wizard and Command line failing.
Command line captures below error: Did any one solved this issues? Kindly help
Calling custom action Microsoft.IdentityManagement.SharePointCustomActions!Microsoft.IdentityManagement.ManagedCustomActions.SharepointCustomActions.DoesWebsiteOrSolutionPackExist
Property name = 'SHAREPOINT_URL', value = 'http://myurl.
Property name = 'UILevel', value = '2'.
CustomAction CheckFIMWebSiteorSolutionPackExisting returned actual error code 1603 (note this may not be 100% accurate if translation happened inside sandbox)
Action ended 0:27:20: CheckFIMWebSiteorSolutionPackExisting. Return value 3.
Action ended 0:27:20: INSTALL. Return value 3.
Aswathy Raj

Installing FIM reporting...

Hi all
We currently have a working single-server installation of FIM (FIMService, FIMSyncService, FIMPortal) and I'm looking ways to expand the installation with reporting features, with SCSM 2012. I was thinking about going with the 2 server configuration.
What should I install on the box I already have, SCSM Management console correct? Does it need a SQL instance?
And I build another server which also has SQL and I'll instal SCSMDW there?
What service accounts does SCSM and FIM reporting features need?
Thanks all!

You are looking of ways to expand the installation? Is this to meet any particular requirement? Are you looking for high availability?
For Reporting Services and SCSM there is a fairly large database footprint required, I have personally just implemented it for a customer into test and we decided to go with a dedicated SQL Cluster.
This would be a good place to start https://technet.microsoft.com/en-us/library/jj133853(v=ws.10).aspx
I would ensure you have the FIMService, SyncService etc DBs backed up with the encryption keys and a warm FIM server standing by if you are doing this in prod.
Ryan Betts
blog.ryanbetts.co.ik

Unable to run FIMPostInstallScriptsForDataWarehouse for FIM Reporting

Hi Everyone,
I am configuring FIM Reporting in which initially I installed scsm 2012 r2 which was not supported and after the uninstallation I installed scsm 2012 sp1,after the installation of scsm management server 2012 sp1 and dataware house when I am running the "FIMPostInstallScriptsForDataWarehouse"
script it says the following error message in the first screen and when I am trying to install the snappins then it says me to delete this existing files in the second screen.
My question is how and where should go I go and delete that exisiting snappins so that the script can run. please find the below screen shots
+

Hi,
Can you check payroll status of the mentioned employees in PA30. (IT0003)
See whether employee number has been locked for payroll or there are dates in the fields for retroactive calculation etc.
Regards;
Okan

Error Installing FIM Reporting in FIM 2010 R2 with SP1 - SCSM 2012 [CheckFIMWebSiteorSolutionPackExisting]

I am running into the below issue. I am installing FIM 2010 R2 SP1 Reporting with SCSM 2012 [SCSM successfully installed].
FIM R2 Reporting installation is failing with both Wizard and Command line.
Command line captures below error: Can some one help on this?
Calling custom action Microsoft.IdentityManagement.SharePointCustomActions!Microsoft.IdentityManagement.ManagedCustomActions.SharepointCustomActions.DoesWebsiteOrSolutionPackExist
Property name = 'SHAREPOINT_URL', value = 'http://myurl.
Property name = 'UILevel', value = '2'.
CustomAction CheckFIMWebSiteorSolutionPackExisting returned actual error code 1603 (note this may not be 100% accurate if translation happened inside sandbox)
Action ended 0:27:20: CheckFIMWebSiteorSolutionPackExisting. Return value 3.
Action ended 0:27:20: INSTALL. Return value 3.
In below link, the above question is unanswered. Kindly help.
http://social.technet.microsoft.com/Forums/systemcenter/en-US/37b1af85-aef0-422b-9417-7364d51d0df4/installing-fim-reporting-in-fim-2010-r2-with-sp1?forum=systemcenterservicemanager

Hi All,
Though we use SCSM 2012, the FIM 2010 Reporting (R2 SP1) installation throws the alert to run
KB2561430 hotfix (when run throght console) and above error (when run through commnad line).This is actually a bug and MS have fixed that in one of its FIM hotfix rollup. I could move out of the above error by applying the FIM hotfix mentioned
in the below link.
http://blogs.technet.com/b/steady/archive/2013/06/12/fim-2010-r2-sp1-reporting-failure-scsm-2012-sp1-you-must-apply-patch.aspx
Aswathy Raj

FIM Reporting and SQL collation

In our existing FIM 2010 R2 implementation, we used the default collation of SQL 2008 R2, which is SQL_Latin1_General_CP1_CI_AS.
However, reading some articles, I got the impression that SQL server will need to be installed with Latin1_General_100_CI_AS collation for installing System Center 2012. I also read that FIM Service database will need to be in the same collation
(i.e. Latin1_General_100_CI_AS). This means we will need to rebuild the SQL server for FIM service.
However, reading the following article, I get a different impression. As long as the collation across all the SQL servers is the same, we should be good. Also, it is actually recommended to use SQL_Latin1_General_CP1_CI_AS rather than Latin1_General_100_CI_AS.
In fact, The SCOM data warehouse installer will always install the data warehouse with SQL_Latin1_General_CP1_CI_AS regardless of the SQL Server collation.
http://blogs.technet.com/b/servicemanager/archive/2012/05/24/clarification-on-sql-server-collation-requirements-for-system-center-2012.aspx
Can anybody please confirm the requirement?

Thanks Brian
I am planning to put ALL FIM roles onto two nodes behind F5. I understand that FIM reporting has to be installed with FIMservice so yes I want to install FIM reporting role onto both FIMService nodes. I understand that I CAN do this from your response (thankyou)
because "there's a safeguard in place to ensure that only one server processes the reporting jobs at a time if it's enabled on more than one FIM Service server
Can you explain what or how this safeguard works - specifically which FIMService node will run this and how the other FIMService node (2) will pick up the job if the first FIMService (node 1 )fails - do I have to configure anything ?
Brian- with respect ; is Tomek's reply incorrect in the context of my configuration - otherwise I would need a standalone FIM Service server (not part of the F5 virtual server) running Reporting with no FIM reporting HA (beyond Hyper-V or other single node
HA options) ?
I realllllyyyy appreciate this feedback and discussion as I have found very little w3 or forum information about load balancing and HA for FIM reporting (I don't mean the SCSM or DW components)
Thanks again
Nigel

Installing FIM Reporting in Productrion Server with mutilple portal

Hi,
I have 5 FIM Portal Server in production. I need below clarification.
Can you confirm if I can install FIM Reporting in just one server which have FIM Service installed on that?
Or
Should we run this on every FIM Service Portal [Suppose we have 5 Portal Servers]?
Can someone clarify my doubt?
I understand FIM Reporting is a component of FIM Service. So FIM Reporting installation should not depend on how many portal production architecture have, it can be installed on one of the FIM Service Server.
Aswathy Raj

On Mon, 27 Jan 2014 10:44:13 +0000, Aswathy Raj wrote:
I have 5 FIM Portal Server in production. I need below clarification.
Can you confirm if I can install FIM Reporting in just one server which have FIM Service installed on that?
Or
Should we run this on every FIM Service Portal [Suppose we have 5 Portal Servers]?
Can someone clarify my doubt?
I understand FIM Reporting is a component of FIM Service. So FIM Reporting installation should not depend on how many portal production architecture have, it can be installed on one of the FIM Service Server.
FIM Reporting really has nothing at all to do with the portal directly:
http://technet.microsoft.com/en-us/library/jj133842%28v=ws.10%29.aspx
Paul Adare - FIM CM MVP
I hope that's not UI -- but the proper term is a "Jet database", accessed
through the "Jet engine". A fitting name, considering that it sucks and
blows. -- Felix about Exchange's mailbox format

FIM Reporting alternative

Similar Messages

Maybe you are looking for