Stream Analytics - no output events

Hi,
I have a problem with stream analytics job. Job monitor shows input events (from Event Hub) but there are no output events or errors. Job is really simple, just to write every input to blob storage:
SELECT * FROM input
Any suggestions what could be wrong?

Thanks for reply,
I have two stream analytics jobs with the same input (event hub).
First job (working)
Simple query (SELECT * FROM input) and output is properly saved to blob storage.
Second job (not working)
More complex query (count, avg etc.) but no output events or errors. Query is working fine (tested with sampled data from input).

Similar Messages

PowerBI & Azure Stream Analytics jobs login issue

Hello team,
We are working as early-adopter partner for Azure Stream Analytics along with azure IoT suite, we recently have got 'PowerBI' services enabled as 'output' connector of stream analytics job on our corporate subscription & accessing our same org. id to
login into Azure Stream analytics & powerBI services.
But, to the great surprise, after creating SA job, configured 'powerbi' as output , it's getting redirect for authorization , applied powerbi 'dataset' & 'table' name. But, after logged into the app.powerbi.com portal, not able to see the 'stream analytics
job dataset' & 'table'.
Note: We are using same Org id for login & creating SA jobs & login into powerbi preview portal.
Would be great if there's a specific instructions/guide for connecting powerbi with ASA job apart from this. Any pointer will be appreciated.
Thanks,
Anindita Basak
MAX451, Inc.
Anindita

Hello there,
Thanks for the reply.
No , we're not able to see any event status as 'Failed' on SA operation logs. Attached the relevant screenshot of event logs.
The jobs are running fine, if we use SQL Azure tables as 'output' connector, the data is available. Only using PowerBI output connector, 'datasets' are not visible though we're using same org id (i.e
[email protected]) for creation of ASA jobs & login into powerbi subscription.
Thanks for your help!.
Anindita Basak
MAX451, Inc
Anindita

Stream analytics - Exceeded the maximum number of allowed receivers per partition in a consumer group which is 5

Hi,
I have configure stream analytics to read messages from eventhub and I am getting this error message:Correlation ID:
e185534f-9e82-4efc-8050-5294796fb275
Error:
Exceeded the maximum number of allowed receivers per partition in a consumer group which is 5 TrackingId:4569eca8-cb70-4c50-96cd-5868bfbc3e37_B45,TimeStamp:1/7/2015 11:40:37 PM TrackingId:f408292e-0dab-40cc-8ae9-2730313c3241_B45, Reference:8fca3c6a-b0d1-41cf-a835-f7c74a2ea8c3,
Timestamp:1/7/2015 11:40:37 PM
Message:
Exceeded the maximum number of allowed receivers per partition in a consumer group which is 5
Message Time:
2015-01-07 23:40:38Z
Microsoft.Resources/EventNameV2:
sharedNode92F920DE-290E-4B4C-861A-F85A4EC01D82.naveenevents_0_c76f7247_25b7_4ca6_a3b6_c7bf192ba44a#0.output
Microsoft.Resources/Operation:
Receive Events
Microsoft.Resources/ResourceUri:
/subscriptions/f122f431-ddc7-4e21-ae3a-f6a9e1273bcb/resourceGroups/StreamAnalytics-Default-Central-US/providers/Microsoft.StreamAnalytics/streamingjobs/Naveenstreamanalytics
Type:
EventHubInputAdapterEventHubFailure
Any help on the same is appreciated.
Thanks
Naveen

Hi Naveen,
Thanks for reporting this issue. We are taking a look at this issue.
Questions:
Do you have multiple readers reading from this EventHub, or have you setup multiple Stream Analystics jobs reading from this event hub. You are hitting a limitation of how many readers are allowed per EH consumer group.
What is the serialization format of your input (JSON/CSV)? Could you please verify the serialization format setup in the streaming job and if it matches your data?
Thanks
Zafar Abbas

Error upon inserting data in sql Database using stream analytics job: Datatye error conversion

I have a data passed into the Event Hubs, queried by stream analytic job inserting it into sql database. Upon running the job, it becomes idle a few seconds after since it has an error:
Message: Conversion from 0 to System.Boolean failed. 0 was of type - System.Int64.
Conversion from 0 to System.Boolean failed. 0 was of type - System.Int64. Exception message at level [1], exception number [0], parent exception number [0]: Conversion from 0 to System.Boolean failed. 0 was of type - System.Int64.
The data type in one of my field(IsHistorical) is Boolean with a value of false. The data type of the column in the sql table where this is to be inserted is of type bit. In this case, it seems that stream analytics could not convert the value "false"
into a bit data type when inserting in sql table.
I'm wondering if you already have encountered this problem. Could you help me resolve this problem?
Thank you.

Azure Stream Analytics does not have Boolean type. On input we will convert JSON Boolean value to bigint.
Here is the list of supported types and conversions:
https://msdn.microsoft.com/en-us/library/azure/dn835065.aspx
You can fix this erro by changing column type from bit to int in SQL table schema.

Starting Stream Analtyics says output was not defined in query

I get the following error when starting my streaming analytics setup:
Stream Analytics job has validation errors: The output output used in the query was not defined. Activity Id: 'c0d50509-a2a9-4a8c-846d-5bf01b751344-2015-04-18 22:37:42Z'.
What does this error mean? And more importantly, how can I fix this?
I found some reference material using the "INTO" statement in the query, however this doesn't work for me and indicated that me query is incorrect. So I guess this function is obsolete?

The likely cause of this error is that you do not an output with the default name defined for your job.
If your SQL query does not use a named output, that is it does not use the INTO keyword that it is expected that you have a default output defined for the job (with name "output"). The error message does not tell you that clearly and that is a
bug we will work on fixing.
If your SQL query does use the INTO keyword, then you simply need to use the same name of the output as you have defined for your job. If you are running into an issue making that work please let us know.
Thanks
Zafar Abbas

At Selection-screen output event

Hi
can any one give me some examples for at selection-screen output event
with regards
nagaraj
Moderator message: please search for available information/documentation.
Edited by: Thomas Zloch on Nov 8, 2011 12:13 PM

Thanks Benedict
Creating Module %_S_KOSTL and write our own logic to bring the parameter id value of Cost center from User profiles is NOT possible in program RM06BF00, screen 1000.
We can do that in Copied program of RM06BF00 ..which is the very last option.
I wanted to do that with User-exits or BADI or Enhancement spot etc...which i Couldn't do it so far...
The alternate might be Zprog and Ztcode or an SNOTE..
if you ALL think its NOT possible with User-exits or BADI or Enhancement spot or SNOTE etc..Then i will close this Thread...
Please let me know ASAP...
Thanks
Govi

AT SELECTION-SCREEN OUTPUT event of standard tcode

Hi
I need User-exit or BADI or Enhancment spot in AT SELECTION-SCREEN OUTPUT event of ME55.
I need to populate the default cost center into the cost center field from user parameters with pid 'KOS' when i execute the ME55.
I maintained the PID in user parameters but the value is not getting populated in ME55.
Please let me know
Govi

Thanks Benedict
Creating Module %_S_KOSTL and write our own logic to bring the parameter id value of Cost center from User profiles is NOT possible in program RM06BF00, screen 1000.
We can do that in Copied program of RM06BF00 ..which is the very last option.
I wanted to do that with User-exits or BADI or Enhancement spot etc...which i Couldn't do it so far...
The alternate might be Zprog and Ztcode or an SNOTE..
if you ALL think its NOT possible with User-exits or BADI or Enhancement spot or SNOTE etc..Then i will close this Thread...
Please let me know ASAP...
Thanks
Govi

Authentication for Stream Analytics REST Api

Hi there,
I am trying to use the stream analytics rest api from a java client. For other services (storage services for example), I am able to successfully use mutual certificate authorization. I create a management certificate using keytool and upload it through
the settings tab in azure portal. I then create an SSLContext from this certificate. This all works and I am able to get access to the storage services api.
The same flow does not seem to work for stream analytics api. When attempting to make an api call, I get 401 error code with the following response authorization header.
GET https://management.azure.com/subscriptions/{subscriptionId}/providers/Microsoft.StreamAnalytics/streamingjobs?api-version=2014-10-01-preview
WWW-Authenticate=[Bearer authorization_uri="https://login.windows.net/{...}", error="invalid_token", error_description="The access token is missing or invalid."]
The result is the same whether or not I configure the certificate on the client side. So, it seems like the mutual certificate authorization is not supported in stream analytics as it is in the other management APIs. Can you confirm if this feature is not
supported? If it is not supported, can you please provide some information on how we should be authenticating for stream analytics REST api?
Thanks

I did some more investigating. The Azure Stream Analytics REST Api documentation uses
https://management.azure.com/
as the base uri for managing stream analytics service. The .NET azure sdk source code on github, however, uses
https://management.core.windows.net/
for the same. So, I have tried accessing some different variations of resources.
https://management.core.windows.net/{my subscription id}/services/storageservices
Response: 200 OK
Here, I am using mutual certificate authorization to successfully reach storage services at management.core.windows.net. This verifies that the certificate authorization flow works for other services in the same subscription.
https://management.azure.com/subscriptions/{my subscription id}/resourcegroups/StreamAnalytics-Default-Central-US/providers/Microsoft.StreamAnalytics/streamingjobs?api-version=2014-10-01-preview
Response: 401 Unauthorized
Message: {"error":{"code":"AuthenticationFailed","message":"Authentication failed. The 'Authorization' header is not present or provided in an invalid format."}}
Now I attempt to use the same mutual certificate authorization on the management.azure.com base uri for stream analytics management. The request fails and the error message notes that an expected Authorization header is missing. This leads me to
believe that mutual certificate authorization is not supported on management.azure.com.
The Authorization header makes sense for OAuth2 flow, so I am thinking that management.azure.com
might only support OAuth2. I need server to server management, so OAuth2 flow will not work because it requires interactive browser redirect to work with management api. Active
Directory only gives delegate permissions to management services, not application permissions. I believe this rules out using OAuth2 / Active Directory for headless
authorization - please correct me if I am wrong.
https://management.core.windows.net/subscriptions/{my subscription id}/resourcegroups/StreamAnalytics-Default-Central-US/providers/Microsoft.StreamAnalytics/streamingjobs?api-version=2014-10-01-preview
Response: 403 Forbidden
Message: <Error xmlns="http://schemas.microsoft.com/windowsazure" xmlns:i="http://www.w3.org/2001/XMLSchema-instance"><Code>ForbiddenError</Code><Message>The server failed to authenticate
the request. Verify that the certificate is valid and is associated with this subscription.</Message></Error>
Here I try to use the mangagement.core.windows.net base uri that is used in .net sdk. I get a 403 forbidden response. The error message indicates that the server attempted to complete the mutual certificate authorization. The server complains, though,
that the certificate is invalid. This is the same certificate used successfully to manage storage services, so I know the certificate is valid and the client flow works.
It would be great if someone could expand on the discrepancy between the base uri in the documentation vs .net sdk and provide some guidance on server to server authorization to stream analytics management api.
Thanks,
Dave

What are list of output events?

hi,
i am siva,
i am new to ABAP language,
i have one doubt..
tell me the list of output events in abap ..?
if u know answer..
mail me..
FOR BEST ANSWERS POINTS WILL BE GIVEN.

hi,
output events are.........
start-of-selection.
using this event we can genarate basic list.
end-of-selection.
we can use this event also for genarating basic list
top-of-page.
this event is related to list, we can use this event to providing list header.
end-of-page.
this event is related to list, we can use this event to providing list footer.
if our program reading data from logical database, in that case GET and
GET LATE events triggered to genarate report.
interactive repotrs.
we use AT LINE -SELECTION and AT USER-COMMAND events to genarate secondary events based on user actions.
TOP-OF-PAGE DURING LINE-SELECTION EVENT, provides page heading to all secondary lists.
PBO and PAI events also used to genarating list.
regards,
AshokReddy.

App for streaming the audio output of the Mac via blouetooth to iphone

HI,
Looking for an app that streams the audio output of the Mac via blouetooth to iphone.
Thx

Please pardon the intrusion…
Hi, roaminggnome!
Congratulations on advancing to Level 4!
At the Water Cooler in the Level 4 Lounge, we are throwing virtual confetti in celebration of your attainment of Level 4-dom. Would you care to join us at the Water Cooler?
On the Discussions Home Page, down at the bottom, you will, hopefully, soon find the Lounge link available to you.
Hope to see you there soon!

How can I stop iPhoto from grouping each month's Photo Stream into one huge event?

My iPhoto preferences are set to split events up based on 2-hour time periods. But photos that enter my iPhoto library via Photo Stream (basically all photos from my iPhone) get grouped into one big monthly event (i.e. titled something like "Jun 2012 Photo Stream"), which I then have to manually break up into smaller, more meaningful events.
Does anyone know of a way to make this behaviour stop? I'd prefer that iPhoto follow the preferences I have set, which is to break up events based on 2-hour time spans.

The problem is that every import is at least one new Event, and so it's quite possible that you could have 1,000 new Events every month thanks to Phootstream.
However, it's not such a huge deal to just select the Event at the end of the month and auto-split it (in the Events menu)
Regards
TD

Pulseaudio: change all playback streams to different output device

Say I have two speakers and both firefox and mplayer are playing to speaker 1. With just one command, can I change firefox and mplayer to speaker 2?
Setting the "default sink" only changes the default; I could care less about the default, I want it to change instantly.
I've looked into pavucontrol, pacmd/pactl, pulseaudio_ctl, and even pamixer-git. I've read all the man pages, and the only solution I could find is to change each playback stream one at a time. This means writing a script that loops over each playback stream and changing them to the alternate sink.
For some extra insight, here is what I would do in windows/mac: disable speaker 1, enable speaker 2.
Last edited by sankeytm (2012-03-18 11:27:24)

That works very well!
However, there is one minor problem (not the script's fault). I don't know how mpd handles streams, but I use moc and when I pause the music the stream closes. This means calling the script while moc is paused will not change its sink. The easy workaround is to force-refresh the streams by calling the script a couple more times.

Music stream breaks when output is bluetooth over wifi

Hi,
I own Iphone 4s which runs IOS 6.
I’m streaming music to bluetooth device from sky.fm, audio galaxy and similar applications.
When the iphone is connected to the network via wifi, the music stops every ~2 minutes,for a second or less – very annoying.
This doesn’t happen when I’m connected to the network via 3g.
I've tried to disable all services which polls for data (e.g. mail) but nothing help
Any advice,

Didn't think of that, thanks. Great workaround.I'm going to call Sky, see if they have any firmware updates or other solution. Surely they wouldn't leave such a big knows issue unfixed. I'll report back with what they say. Edit:Just got off the phone from Sky technical support.This issue was first reported Nov/Dec 2014.The chap I spoke to does not know of a fix, or whether a fix is being worked on, or if a fix will ever be worked on.He has not way of contacting the development team to find out any of this information.He said firmware updates are pushed out to routers every now and again. He does not know when this is going to happen and does not have a way to notify about firmware updates installed on my router. (This terrifies me. Sky have a backdoor into my router and can install any code they wish, without even telling me what they changed/installed). There is no way to turn these auto-updates off either. Here's a key thing he did say though:He said he was not at liberty to provide my ADSL credentials, but if I chose to extract them from the router and install my own router instead, they would not have any problem with that.When I told him that this was against their TOS and they could terminate my contract for doing this, he went silent and just said "errr..." Allowing Sky, their subcontractors and anyone else they choose to install any code they wish to my router whenever they please and have free open access to my entire LAN is a total deal breaker for me. That router is getting unplugged today and I'm putting a new router on the credit card. I told tech support this. I said if they have a problem with that, let's go the legal route. I literally have a recorded call where they give me permission to install my own router.

Data Conversion Errors for the last week

We've been running a simple Stream Analytics job for little over a month now with a very light workload. Input is Event hub and output SQL Server. We noticed today that we haven't received anything into SQL Server since 2014-12-08 (we don't receive events
every day so we only know that everything still worked on the 8th of December), so we checked the job's logs. It seems that job is failing to process all the messages: The value of "Data Conversion Errors" is high.
I wonder what could have happened? We haven't touched the client since we started the job so it's still sending the messages in same format. And we haven't touched the job's query either.
Has there been an update to either to Stream Analytics or to Events Hub which could cause the issue we're seeing?

I've followed word for word the TollApp Instructions (except the thing with NamespaceType "Messaging" that has been added to New-AzureSBNamespace).
I have 0 line in output, and this is the service log:
Correlation ID:
e94f5b9e-d755-4160-b49e-c8225ceced0c
Error:
Message:
After deserialization, 0 rows have been found. Possible reasons could be a missing header or malformed CSV input.
Message Time:
2015-01-21 10:35:15Z
Microsoft.Resources/EventNameV2:
sharedNode92F920DE-290E-4B4C-861A-F85A4EC01D82.entrystream_0_c76f7247_25b7_4ca6_a3b6_c7bf192ba44a#0.output
Microsoft.Resources/Operation:
Information
Microsoft.Resources/ResourceUri:
/subscriptions/eb880f80-0028-49db-b956-464f8439270f/resourceGroups/StreamAnalytics-Default-West-Europe/providers/Microsoft.StreamAnalytics/streamingjobs/TollData
Type:
CsvParserError
Then I stopped the job, and connected to the event hub with a console app and received that:
Message received. Partition: '11', Data: 'TollId,EntryTime,LicensePlate,State,Make,Model,VehicleType,VehicleWeight,Toll,Tag
85,21/01/2015 10:24:56,QBQ 1188,OR,Toyota,4x4,1,0,4,361203677
Message received. Partition: '11', Data: 'TollId,EntryTime,LicensePlate,State,Make,Model,VehicleType,VehicleWeight,Toll,Tag
33,21/01/2015 10:25:42,BSE 3166,PA,Toyota,Rav4,1,0,6,603558073
Message received. Partition: '11', Data: 'TollId,EntryTime,LiMessage received. Partition: '10', Data: 'TollId,EntryTime,LicensePlate,State,Make,Model,VehicleType,VehicleWeight,Toll,Tag
59,21/01/2015 10:23:59,AXD 1469,CA,Toyota,Camry,1,0,6,150568526
Message received. Partition: '10', Data: 'TollId,EntryTime,LicensePlate,State,Make,Model,VehicleType,VehicleWeight,Toll,Tag
25,21/01/2015 10:24:17,OLW 6671,NJ,Honda,Civic,1,0,5,729503344
Message received. Partition: '10', Data: 'TollId,EntryTime,LicensePlate,State,Make,Model,VehicleType,VehicleWeight,Toll,Tag
51,21/01/2015 10:24:23,LTV 6699,CA,Honda,CRV,1,0,5,169341662
Note the bug on the 3rd message. In my opinion it's unrelated, it could be the writeline that can't keep up with the stream in the console application. And at worst it's in the stream, but then I should see at least some lines in output for the correctly
formatted messages.

Most simple query on Event Hub stream (json) constantly gives Data Conversion Errors

Hello all,
Been playing with ASA in December and didn't have any issues, my queries kept working and outputted the data as needed. However, since January, I created a new demo, where I now constantly get Data Conversion errors. The scenario is described
below, but I have the following questions:
Where can I get detailed information on the data conversion errors? I don't get any point now (not in the operation logs and not in the table storage of my diagnostic storage account)
What could be wrong in my scenario and could be causing these issues
The scenario I have implemented is the following:
My local devices send EventData objects, serialized through Json.Net to an Event Hub with 32 partitions.
I define my query input as Event Hub Stream and define the data as json/utf8. I give it the name TelemetryReadings
Then I write my query as SELECT * FROM TelemetryReadings
In the output, I create an output on blob with CSV/UTF8 encoding
After that, I start the job
The result is an empty blob container (no output written) and tons of data conversion errors in the monitoring graph. What should I do to get this solved?
Thanks
Sam Vanhoutte - CTO Codit - VTS-P BizTalk - Windows Azure Integration: www.integrationcloud.eu

So, apparently the issue was related to the incoming objects, I had. I was sending unsupported data types (boolean and Dictionary). I changed my code to remove these from the json and that worked out well. There was a change that got deployed
that (instead of marking the unsupported fields as null, they were throwing an exception). That's why things worked earlier.
So, it had to do with the limitation that I mentioned in my earlier comment:
https://github.com/Azure/azure-content/blob/master/articles/stream-analytics-limitations.md
Unsupported type conversions result in NULL values
Any event vales with type conversions not supported in the Data Types section of Azure Stream Analytics Query Language
Reference will result in a NULL value. In this preview release no error logging is in place for these conversion exceptions.
I am creating a blog post on this one
Sam Vanhoutte - CTO Codit - VTS-P BizTalk - Windows Azure Integration: www.integrationcloud.eu

Stream Analytics - no output events

Similar Messages

Maybe you are looking for