Running SQL agent jobs in parallel

Question

I have around 60 SQL agent jobs (each job has 1 step that loads data from ORACLE to SQL using attunity) that run SSIS packages that I need to run in parallel.  I did some testing and found that the server can handle 10 of them running at the same time.
 I know I need to loop through sysjobhistory and find the ones (all 60 jobs start with PS) that haven't ran today, currently not running and the first tow words of the name = 'PS'.  Any advice on how to get this accomplished would be appreciated.
I have seen some articles that mention adding 10 data flows to a SSIS package and run them that way but I would like for SQL to handle it, so I can get the time.
Thanks!

Answer 1

That will definitely help identify the jobs but I need to figure the looping logic that will allow 10 jobs to run in parallel.
try this.. not tested.. left comments where possible for you to understand..may need to tweak it a bit..
declare @a intset @a=0
declare @jobname nvarchar(200)
-- checks if there are already 10 jobs running
while (@a <10) and ((Select count(C.Name) as [JobName]
from (Select max(Session_id) as Session_Id from msdb.dbo.syssessions) A
INNER JOIN msdb.dbo.sysjobactivity B on A.Session_id=B.Session_ID
INNER JOIN msdb.dbo.sysjobs C on B.job_id=C.Job_ID
where B.stop_execution_date is null AND B.run_requested_date is not null and C.Name like 'PS%') < 10)
begin
--loops through to fetch one non-running job at a time and fetches upto 10 jobs
Select top 1 @jobName = name
from msdb.dbo.sysjobs X
INNER JOIN msdb.dbo.sysjobactivity Z on Z.job_id=X.Job_ID
where name like 'PS%' and
--checks the job is currently not running
name not in (
Select C.Name as [JobName]
from (Select max(Session_id) as Session_Id from msdb.dbo.syssessions) A
INNER JOIN msdb.dbo.sysjobactivity B on A.Session_id=B.Session_ID
INNER JOIN msdb.dbo.sysjobs C on B.job_id=C.Job_ID
where B.stop_execution_date is null AND B.run_requested_date is not null)
--makes sure the job already did not run today
and cast(Z.run_requested_date as date)<>cast(getdate() as date)
order by name
Execute msdb.dbo.sp_start_job @job_Name=@jobName
set @a=@a+1
End
Hope it Helps!!