SMA Runebooks stuck in Queued state

I'm having problems with a jobs not processing at all. They say they are in a queue state when you look at them in the console but when you run "Get-SmaJob -WebServiceEndpoint 'https://smaws.mycompany.com' -port 9090 | where-object {$_.jobstatus -ne
'Completed'}" the jobstatus comes back as new. I tried to cancel them with "stop-smajob -id 5a8fc19f-4158-433b-a3a9-7a22398f4eed -WebServiceEndpoint 'https://smaws.mycompany.com' -port 9090" and I get this message 
stop-smajob : Could not stop job 5a8fc19f-4158-433b-a3a9-7a22398f4eed: System.Data.Services.Client.DataServiceClientException: <?xml version="1.0" encoding="utf-8" 
standalone="yes"?><error xmlns="http://schemas.microsoft.com/ado/2007/08/dataservices/metadata"><code></code><message 
xml:lang="en-US">System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---&gt; 
System.Data.EntityCommandExecutionException: An error occurred while executing the command definition. See the inner exception for details. ---&gt; 
System.Data.SqlClient.SqlException: Error 50000, Level 11, State 1, Procedure UpdateJob, Line 110, Message: The requested update for the Job is not allowed. The job has 
already a PendingAction.&#xD;
   at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)&#xD;
   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)&#xD;
   at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, 
TdsParserStateObject stateObj, Boolean&amp; dataReady)&#xD;
   at System.Data.SqlClient.SqlDataReader.TryConsumeMetaData()&#xD;
   at System.Data.SqlClient.SqlDataReader.get_MetaData()&#xD;
   at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)&#xD;
   at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async, Int32 timeout, 
Task&amp; task, Boolean asyncWrite, SqlDataReader ds)&#xD;
   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, 
TaskCompletionSource`1 completion, Int32 timeout, Task&amp; task, Boolean asyncWrite)&#xD;
   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)&#xD;
   at System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior, String method)&#xD;
   at System.Data.SqlClient.SqlCommand.ExecuteDbDataReader(CommandBehavior behavior)&#xD;
   at System.Data.EntityClient.EntityCommandDefinition.ExecuteStoreCommands(EntityCommand entityCommand, CommandBehavior behavior)&#xD;
   --- End of inner exception stack trace ---&#xD;
   at System.Data.EntityClient.EntityCommandDefinition.ExecuteStoreCommands(EntityCommand entityCommand, CommandBehavior behavior)&#xD;
   at System.Data.EntityClient.EntityCommandDefinition.Execute(EntityCommand entityCommand, CommandBehavior behavior)&#xD;
   at System.Data.EntityClient.EntityCommand.ExecuteReader(CommandBehavior behavior)&#xD;
   at System.Data.EntityClient.EntityCommand.ExecuteScalar[T_Result](Func`2 resultSelector)&#xD;
   at System.Data.Objects.ObjectContext.ExecuteFunction(String functionName, ObjectParameter[] parameters)&#xD;
   at Orchestrator.ResourceModel.OrchestratorApi.UpdateJob(Nullable`1 jobKey, Nullable`1 jobId, String jobStatus, Nullable`1 setjobStatus, String pendingAction, String 
pendingActionData, Nullable`1 setpendingAction, Nullable`1 partitionId, Nullable`1 setPartitionId, Nullable`1 ownerId, Nullable`1 setownerId, Nullable`1 
workflowInstanceId, Nullable`1 setworkflowInstanceId, String jobException, Nullable`1 setJobException, Nullable`1 forceUpdate, ObjectParameter 
jobStatusUpdateResult)&#xD;
   at Orchestrator.WebService.ActionContext.UpdateJob(Guid jobId, JobPendingAction jobPendingAction, String pendingActionData)&#xD;
   at Orchestrator.WebService.ActionContext.Stop(Job job)&#xD;
   --- End of inner exception stack trace ---&#xD;
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)&#xD;
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)&#xD;
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)&#xD;
   at EntityFrameworkActionProvider.ActionInvokable.&lt;&gt;c__DisplayClass3.&lt;.ctor&gt;b__0()&#xD;
   at EntityFrameworkActionProvider.ActionInvokable.Invoke()</message></error>
   at System.Data.Services.Client.BaseAsyncResult.EndExecute[T](Object source, String method, IAsyncResult asyncResult)
   at System.Data.Services.Client.QueryResult.EndExecuteQuery[TElement](Object source, String method, IAsyncResult asyncResult)
At line:5 char:1
+ stop-smajob -id 5a8fc19f-4158-433b-a3a9-7a22398f4eed -WebServiceEndpoint 'https: ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (:) [Stop-SmaJob], InvalidOperationException
    + FullyQualifiedErrorId : System.InvalidOperationException,Microsoft.SystemCenter.ServiceManagementAutomation.StopSmaJob
I've tried the steps here, but no long so far. http://www.concurrency.com/infrastructure/sma-runbooks-stuck-queued-status/
Any ideas would be helpful.
Matt

Hi,
with "Get-SmaRunbookWorkerDeployment -WebServiceEndpoint https://WebServer.domain.com" make sure there are registered Runbook Workers. At at that host(s) make sure that the service "Runbook Service" is running ...
Regards,
Stefan
www.sc-orchestrator.eu ,
Blog sc-orchestrator.eu
I can see all three of my SMA servers but they dont have lookup names. Not sure if that matters or not. They are all on the same domain and vlan so there isnt a firewall between them.

Similar Messages

  • [SOLVED] Mailbox import requests stuck in 'queued' state

    We have a small Exchange 2013 environment with one server having all roles. I try to import archive mailboxes from an Exchange 2010 environment. It has worked quite well for a while. However, all import requests are now 'stuck' in 'queued' state. Restart
    of Replication service, transport service and even server reboot didn't help.
    When I run
    get-mailboximportrequest | Get-MailboxImportRequestStatistics -Includereport | fl
    I observe that PositionInQueue value tells me that there are 85 import requests waiting :
    ItemsTransferred                       :
    PercentComplete                        : 0
    CompletedRequestAgeLimit               : 30.00:00:00
    PositionInQueue                        : 85/90 (Position/Queue Length)
    InternalFlags                          : None
    FailureCode                            :
    There should be no requests waiting as I removed all requests in advance before I issued new import requests:
    get-mailboximportrequest | Remove-MailboxImportRequest
    How can I really reset an import queue by zeroing PositionInQueue ?
    Any suggestions/tips?

    Hi,
    Glade to hear the good news. Thanks for your update.
    Best regards,
    If you have feedback for TechNet Subscriber Support, contact 
    [email protected]
    Belinda Ma
    TechNet Community Support

  • Crystal reports always stay in queued state

    When I run any crystal report, they stay in queued state forever.I have rebooted the appserver and process schedulerand cleared the cache,but the same problem persists.
    Application:FSCM 8.8
    Tools:8.47
    What might be the problem and how can i rectify it?

    It's possible that you have some previous Crystal processes that are in a non-final status. They may be 'stuck' in Processing or Initiated status. If the number of these incomplete processes has reached your maximum concurrent process level, then no additional Crystal processes will run until those incomplete processes are cleared out. I have also seen situations where 'Error' or 'Canceled' processes can prevent future processes from running.
    If you have Crystal processes in anything other than 'Success' status, try deleting those processes through Process Monitor, and see if that allows your queued processes to start.

  • Projects not able to CHECKIN..STUCKING in Queue..

    Hi all,
    I have an issue ,
    Once the Projects are getting published iam not able to checkin the projects as they are getting stucked in queue jobs.Can anyone please comeout witha solution that would be helpful
    Thanks in Advance.
    Regards
    Soumay
    Soumya T | EPM Consultant

    As Guillaume mentioned, try restarting your queue service, but in order to identify the problem we would need some more details along with what Guillaume already mentioned,
    How many threads have been defined for queue
    Sort the Job queue by Position and look for jobs processing from position 1
    When you say your checkin job is stuck what state the job remains in?
    As Queue follows the sequential mechanism to process job, can you check if there are already jobs in the processing state before checkin ?
    Are there any customizations involved like, event handlers on check in or any other thing being performed?
    By my experience in most cases, we have seen slow processing of the queue being influenced by the Database processing and it goes to a whole another level of discussion on the performance
    Once you provide some more info, we would be able to give you some pointers on where & what to look for ?
    Thanks | epmXperts | http://epmxperts.wordpress.com

  • Workflow stuck in starting state after applying SharePoint 2010 CU December 2012

    I have custom visual studio workflow which are associated with Custom content type. workflow gets triggered automatically when a file is uploaded to SharePoint. Everything was working fine till when i apply the following CU
    http://blogs.msdn.com/b/joerg_sinemus/archive/2012/12/27/sharepoint-2010-and-december-2012-cu.aspx
    After applying this my workflow get stuck in "Starting" state.
    No error were logged in 14 hive logs.
    Thanks in Advance!

    It took me a while but I came up with a work around.  There is a PowerShell script below that can be used to trigger the workflow.  Hopefully this will hold all of us over until the official fix arrives.
    First remove the auto start on change or new from the affected workflow
    Edit the script below to match your environment
    Add the script to Windows task scheduler with the PowerShell.exe in the command line
    This assumes PowerShell.exe is in the path
    Then add the full path and script name in the add arguements text box
    Script:
    #The purpose of this script is to start the SPD workflow with the windows task scheduler for a trigger
    #This should avoid the check in-out issue caused by the December 2012 SP CU patch
    #This needs to be run on an account with membership in the farm administration group for SharePoint and Shell in SQL
    #You can use a find and replace to replace the server and other names with your actual names
    #There are no status messages being used since this will be a scheduled task in the Windows task scheduler
    #Add SharePoint modules and create variable space
    add-pssnapin microsoft.sharepoint.powershell
    start-spassignment -global
    #Open the web site, list and the workflow
    $site=get-spsite %site url%"
    $web=get-spweb %Web url%
    #Open the %affected% library or list and workflow association
    $%affected%=$web.getlist("%affected%")
    $manager=$site.workflowmanager
    $culture=[system.globalization.cultureinfo]::currentculture
    $wfname="%affected workflow name"
    $association=$%affected%.workflowassociations.getassociationbyname($wfname,$culture)
    $data=$association.associationdata
    $wfrunoption=[microsoft.sharepoint.workflow.spworkflowrunoptions]::synchronous
    #Start workflow
    foreach ($item in $%affected%.items) {
    $site.workflowmanager.startworkflow($item,$association,$data,$wfrunoption)
    stop-spassignment -global

  • Agent get stucked in Reserved State

    HI CUCCE gurus,
    Need assistance on this issue. In our remote office, our Sales Team has a linegroup setup, the Sales extensions are part of the linegroup and at the same time its their ACD line when they logged in to Cisco Agent Desktop.
    The issue is, when they got a call from the linegroup their CAD state change to "Reserved" and it stuck from that state and nothing they can do to change the state but to logoff, close the apps and log back in.
    I enabled debug on once of the Sales CAD (see attached output).
    Any troubleshooting tips that you can advise or detailed steps to check from our system.
    Our CAD is 7.X
    Our CUCCE is 7.X
    Our CUCM 7.X
    Thank you.

    Hi Jhun,
    Agent stuck in reserved state it means, the ICM has reserved the agent, but the call is not getting delivered to the agent extension.
    If you are using SIP trunk, you would probably need to check the CSS and Partitions over the trunk. Also, any recent changes made on the CSS of the SIP trunk you would need to reset the SIP trunk.
    The CSS on the SIP trunk should contain the partition of the phone.
    Also, you would need to check on the Agent targetting rule in the config manager of the ICM. The agent extensions should be added to the Agent targetting rule
    Hope this helps!!!
    Cheers,
    Dass
    Please rate useful posts

  • Mails/Alerts-triggered for messages stuck in queues and failed in moni

    Hi,
    I have two doubts.
    1) Messages are getting stuck in smq2 of my ECC and PI system. I have to manually push them. Is there any mechanism in which we can get alerts/mails when messages get stuck in queues.
    I have already gone through the blog /people/santhosh.kumarv/blog/2009/05/19/sap-xipi-alerts-for-queue-errors and I have implemented it in ECC system. But no mails were generated.
    2)Is there any method in which I can get alerts/mails when a message fails in sxmb_moni of ECC system?
    Thanks and regards,
    Siji

    Hi Sanjeev,
    I made a report with the following code in it and executed it. So I think that should work even if the job for it is not scheduled. There were messages stuck in queue. But no alert was generated. I had also created alert category in ECC.
    Thanks and regards,
    Siji

  • BPM: Messages stuck in Queue

    Hi All,
           I am working on BPM scenario. My scenario is I am collecting 100 messages in 10 mins and sending to receiver. Here correlation I used as constant. In my deadline step I am using Transform step and Send why because if my scenario collect 10 messages in 10 mins even though i have to send these 10 messages to receiver. Itu2019s same as BpmPatternCollectTime but only difference is in Deadline I kept Transform and send step and the correlation is u2018constantu2019.
          My scenario is working fine most of the time. Sometimes messages are getting stuck in queue. The System error it is displaying as u201CProcess definition WS90XXXXX contains no receive step for message XXXX_PROXY_.....
    Can you please let me know why the messages are getting stuck in queue?
    Thanks & Regards,
    Purushotham

    Hi,
    A message normally gets stuck in a Queue beoz it is waiting for some processing to happen...once this message gets stuck the remaining messages will also get stuck no matter even if you create the whole BPM again.
    The only thing you can ensure is that all the messages are processed successfully before any other message enters the same queue....As of now you can only delete the queue and let the further processing happen successfully...is your Queue being used by some other processess also? If yes then check for their message processing...
    @Divya....your answer seems to be a straight forward Ctrl C --> Ctrl V
    Re: ccBPM Receive Step not Working
    If not then I am surprised by such a level of coincidence...
    Regards,
    Abhishek.

  • Messages stuck in queues

    Hi Gurus,
    I used outbound and inbound proxies to send messages from SAP ECC system to PI system.
    I often see that the messages are stuck in queues in SAP ECC system.
    When I check SMQ2 to check the list of error which is causing the message to stuck in queue, the following error is thrown.
    XI Error CLIENT_RECEIVE_FAILED.INTERNAL: Queue stopped.
    What could be the reason for this.
    There are hundreds of messges getting processed in queues but if one message is stuck in queue all teh following messages are also stuck in queue.
    Can you please suggest how to handle the queues in SAP ECC and SAP PI system and why the error CLIENT_RECEIVE_FAILED.INTERNAL: Queue stopped is thrown in queues
    Any help appreciated.
    Thanks,
    Jay.

    Some more reference
    Introduction to queues: [http://www.sdn.sap.com/irj/scn/weblogs;jsessionid=(J2EE3417200)ID0647143550DB01673835744040254469End?blog=/pub/wlg/2957|http://www.sdn.sap.com/irj/scn/weblogs;jsessionid=(J2EE3417200)ID0647143550DB01673835744040254469End?blog=/pub/wlg/2957]
    [http://www.sdn.sap.com/irj/scn/weblogs;jsessionid=(J2EE3417200)ID0647143550DB01673835744040254469End?blog=/pub/wlg/13748|http://www.sdn.sap.com/irj/scn/weblogs;jsessionid=(J2EE3417200)ID0647143550DB01673835744040254469End?blog=/pub/wlg/13748]
    Mapping related: [http://www.sdn.sap.com/irj/scn/weblogs;jsessionid=(J2EE3417200)ID0647143550DB01673835744040254469End?blog=/pub/wlg/1832|http://www.sdn.sap.com/irj/scn/weblogs;jsessionid=(J2EE3417200)ID0647143550DB01673835744040254469End?blog=/pub/wlg/1832]-
    QUEUE
    PI - Queues
    regards

  • Messages stuck in Queue in production Enviorment

    HI ALL,
    My messages is been stuck in queue in production envoirment. I have checked in SMQ2 Inbound queue .there in status it is showing SYSFAIL.When i am dbclick on stauts it is showing XI error due JCO communication failure.Mapping Queue..
    I am trying to restart thoose messages but are not getting started . what I need to do. Shall I deleted those queues in in SMQ2 or unlock and then restart them.
    Note : this is Production Enviorment ...........is right to delete the queue there while they are showing SYSFAIL status.
    Please suggest.
    Regards

    Hi gangadhar kh
    just few checks
    1) inside the queue check if any message got stuck due to some error . if QOS for that message is EOIO then it will not allow other messages to process until this is not processed
    process that and rest message will get processed
    2) ask you basis team to update java kernel so that on production system this queue stuck problem should not happen frequently
    3) to restart java stack
    run tcode SMICM  go to menu bar click on AS Java menu ->send soft shut down->with restart
    after some time java services will up
    then manually reastrat aal the message
    Regards
    sandeep

  • Messages Stuck in Queue in PI

    Hi,
    For a few inbound interfaces for which PI is the middleware, we have found that the messages are stuck in queue in PI. We have also found that the messages are stuck in the queue in PI because one message which has an RFC error (It does a RFC lookup from PI into R/3).
    Is there any way in which we can trigger the RFC lookup manually for the failed message in the queue in PI?
    If this is not the right forum, please let me know the correct forum.
    Thanks in advance.
    Mick

    Hi,
    We can prevent this problem through standard SAP program RSQIWKEX.  This program need to execute background.  Whenever any message stuck in queue automatically this problem will restart error message automatically.  If you want to delete error message from queue (due to this error message remaining messages are in hold stage.  for remaining message execution we need to delete error message from queue) we need to change one function in this probem.
    Existing function TRFC_QIN_RESET_LUW , this function only can restart error message.
    Need to add function TRFC_QIN_DELETE_LUW , this function delete error message from queue.
    For this program execution we need to mentioned queue name(mandatory), find message stucking queue name and give same name to program in variant.
    I hope now clear

  • Messages stuck in queue AFWRecv of Adapter Framework

    Hello,
    Messages stuck in queue AFWRecv of Adapter Framework in our production system(trace in  RWB: "to be delivered")
    in URL http://xxxxxxx:50000/MessagingSystem/monitor/systemStatus.jsp we can see:
    Queue Info 
    Queue Name isStarted QueueSize ThreadCount (working) MaxThreads
    AFWCall true 0 0 (0) 20
    AFWRecv true 954 10 (10) 10
    AFWRqst true 0 0 (0) 20
    AFWSend true 0 0 (0) 10
    We have tried to resend the first message but that´the result:
    Time Stamp Status Description
    2010-10-09 11:24:06 Success The message was successfully received by the messaging system. Profile: XI URL: http://xxxxxxxxx:8100/MessagingSystem/receive/AFW/XI
    2010-10-09 11:24:06 Success Using connection AFW. Trying to put the message into the receive queue.
    2010-10-09 11:24:06 Success Message successfully put into the queue.
    2010-10-11 00:01:46 Success Recovering from loss of connection to database; message loaded into queue by recover job: System Job (Failover Recovery)
    2010-10-11 02:48:16 Success System Startup: Message successfully loaded into queue: AFWRecv.
    2010-10-13 11:03:19 Success Admin action: Trying to redeliver message.
    2010-10-13 11:03:46 Success Admin action: Trying to redeliver message.
    Since then it stucks there...
    Any help would be apreciated....

    Hi,
    Go to the runtime workbench --> Message Monitoring --> Click on the 'Configure Table Columns' > Check Sequence ID, Serialization Context & Sequential Number options.> and then click 'Apply'.
    Then in the 'Serialization Context' column you will get the queue ID for the stcuk message.
    Take that value and click on the 'Show additional Criteria' option on the top and put this value in the 'Serialization context' parameter. Also,select the start/end date as 'This year' --> start.
    You will get all the messages stuck in that particular queue for this yoear, try to rectify them, so that your message will be processed.
    -Supriya.

  • BPM: Message Stucked in Queue on Error even after Cancel Process

    Hi all,
    We have a scenario where we are using BPM to call RFCs in sequence using BPM. In case of exception, we make use of exception branch and canel the process. But even after doing so, failed messages are stucked in queue and if a new message comes in, it goes in pending status due to previous stucked messages.
    Can anybody please suggest how to overcome this.
    Thanks
    -Kulwant

    You need to make sure that:
    1) You have defined a Exception Handler in your Block
    2) You have included this in the Exception Branch properties.
    3) You have included this under the Exceptions section of your Sync Send Step....
    Even I got into the same situation and then figured out that F7 mentioned Exception will never be raised....why??.....the 3rd point was the reason.....check if same applicable to your case also...
    Regards,
    Abhishek.

  • I have a set of 3 USB disk connected to my TC via a USB hud. I usually swithc the TC at night. When I restart the next day it stucks in amber state. when I disconnect the USB hub where my discs connects and restart, it start properly. Any hints?

    I have a set of 3 USB disks connected to my Time capsule (TC) via a USB hub. I usually switch the TC at night. When I restart the next day it stucks in amber state. When I disconnect the USB hub where my discs connects and restart, the TC will start properly. Any hints?

    LOL.. don't switch off the TC.. this is fairly typical behaviour..
    Or try a different usb hub.. but you could well and truly run out of hubs before you fix the problem.
    Are you running latest firmware for your TC?
    What error message is coming up in the airport utility.. amber led is a fault indicator.. look up what the actual fault is and see if it is for instance overloading the usb. You are using a powered hub??
    Get one bigger USB hard disk instead of 3 smaller ones.

  • Wireless print job stuck in queue

    C5180 print jobs from network are stuck in queue and won't print.  I've reinstalled driver, etc.  Does print from a USB cable connection.  Any ideas?

    I've got a similar problem with the officejet 5510 (multifunction) attached by USB to XP computer.  I can print direct (connected by USB) and wirelessly from my windows 7 laptop.  I can print direct (USB) from my Mac OS 10.4.11  However, when I print wirelessly from the Mac, the print job shows up in the que on the XP machine with the 5510 attached, but wont print.  I have to clear the spool from the command line.
    I've set up the 5510 wirelessly by using the advanced windows printing via Samba, by Lpd to the IP address, and by simply adding the printer in the work group.  All three ways result in network traffic (I see it on the firewall log) and result in a document queued.
    since there is no 5510 officejet (mutlifunction), I have set up the printer with the cups/gutenprint 5.2.7 profiles using several different printers - generic officejet, deskjet 950c, officejet 5110, designjet 5500ps, designjet 5000PS HP 9085MFP.
    I can't get the print job out of the queue/spool and into the printer.
    Any thoughts?

Maybe you are looking for