Some concept confused for Azure Service Bus EventHub

Currently, I’m trying to use the Azure Service Bus Event hub and I have some concepts a little bit confused:
I have create an event hub (our requirement is send 10Kb data per seconds to the event hub), the hub include 10 partitions, then we receive the data using the
EventHubReceiver, when I create the instance for the EventHubReceiver, it need the
PartitionId, so I want to know which partitionId is needed?
 I guess all the Partitions have the same data which I sended, is it right?
Is the PartitionId equals PartitionKey? My understanding is the PartitionId is the indicator for the Partitions in the Event Hub, the PartitionKey is the indicator for the device which send the data, so one Partition can contains many partitonIds,
is it right?
When we receive data from hub, we need set the Consumer Group, so what is the relationship between EventHub and Consumer group?
When we use the EventProcessorHost to receive data, we do not to set the PartitionId, so the data we got is the all PartitionData?
When we call the PartitionContext.CheckpointAsync(), the Event hub will do the things to release the Events(delete, clear or sth) by itself, we needn’t do it in our code,
is it right?
Is there a diagram to show the relationship for concepts of the EventHub?
Thanks a lot!

I'd ask them over here.
Azure forums on MSDN
Regards, Dave Patrick ....
Microsoft Certified Professional
Microsoft MVP [Windows]
Disclaimer: This posting is provided "AS IS" with no warranties or guarantees , and confers no rights.

Similar Messages

  • Which Nuget Package for Azure Service Bus can I use for Windows Store apps?

    Hi,
    I want to use the Azure Service Bus Topics. I have an app that needs to subscribe to the Service bus Topic. The Nuget-Package for Azure Service Bus is not applicable for Windows Store Apps (I get an error during install), thats why I used the Windows Azure
    Service Bus managed for Windows Store. Unfortunatelly this API throws a Serialization Exception when I create a subscription. What can I do to use the Service bus in Windows store apps?
    Thats how I try to create the subscription:
    await Microsoft.WindowsAzure.Messaging.Subscription.CreateAsync(TOPIC_NAME, SUBSCRIPTION_NAME, CONNECTION_STRING);

    Yes this is the one I used.
    But creating a subscription with the code above throws the SerializationException mentioned in this question:
    http://social.msdn.microsoft.com/Forums/de-DE/1acb887e-d5f1-4bfb-8eb9-f8ce7390ae7b/microsoftwindowsazuremessagingsubscriptioncreateasync-throws-an?forum=servbus&prof=required.
    Maybe I do something wrong? Do I Need to do something before creating the subscription?
    I haven't found any sample that shows how you can subscribe to a Topic and receive Messages using the restricted Api for winrt :(
    Any suggestions?

  • Azure Service Bus client: Best way to wait for server response?

    Hi,
    I have a web service that needs to send a request on Azure Service Bus and wait for the response. The web service must operate synchronous as seen from the web service client, that is:
    public Response WebServiceMethod(Request)
    senderQueueClient.Send(Request);
    // wait for response from receiverQueueClient
    // and return to web serviuce client
    return response;
    This can be solved using mutexes that are updated in "receiverClientQueue.OnMessage". But that is hard work and if I Google the matter, I find several options to deal with this - especially when using .NET 4.5.  And there are also some built-in
    stuff in the QueueClient.
    But how to do this best? Can someone point me in the right (easy) direction?
    Werner

    Hi,
    May I know what are you use queue to achieve? can you give us further information for a better help.
    Regards

  • Azure Service Bus Relay & Impersonation

    Hi All,
    I am currently investigating the use of Azure Service Bus Relay for a project, testing has gone well so far and I have a service and client communicating via the service bus relay.
    Currently the client and server are able to take part in two way communication, whereby the client invokes a method and a response is sent back to the client, the problem I have is that I now
    want the service to impersonate the user calling the methods, but only for some of the methods available in the service.  Is this possible over a service bus relay connection? if so, how can this be achieved. 
    I have been able to get this working when calling the service over a non-service bus binding (using basic authentication over SSL), but this fails when binding to the service bus relay, I believe because the HTTP context is lost between the client and
    server when communicating via the intermediary (in this case the service bus)
    Thanks in advance for the advice.
    Chris

    Hi,
    I would suggest that you contact to Azure Support for respective subscription
    Please refer following to know how to submit support ticket
    http://blogs.msdn.com/b/mast/archive/2013/01/22/windows-azure-customer-support-offerings-live-how-to-contact-microsoft-windows-azure-technical-support.aspx
    hope this helps

  • BizTalk 2013 SB-Messaging Adapter: Unable to receive messages from a Azure service bus Subscription

    Hi,
    I am trying to receive messages from a Azure service bus subscription using SB-Messaging Adapter in BizTalk Server 2013 but getting the following error.
    "The token provider was unable to provide a security token while accessing 'https://overcasb-sb.accesscontrol.windows.net/WRAPv0.9/'.
    Error Code: 407 Proxy Authentication Required. The ISA Server requires authorization to fulfill the request. Access to the Web Proxy filter is denied. (12209)
    It seems the error is related with Service Bus Authentication and Authorization with the Access Control Service. Can anybody help me out if I am missing something here? 
    Also for consuming the AWSB (namespace, topic name, subscription name, Issuer name, Issuer Key) I have referred the following link
    http://soa-thoughts.blogspot.in/2013/02/biztalk-server-2013-new-adapters-series.html
    Thanks!
    Regards,
    Gautam
    gautam

    Hi,
    When I am trying to receive the same messages from a Azure service bus subscription using .net (C#) client,
    BusSubscriberbusSubscriber =
    newBusSubscriber("TestTopic2",
    "Endpoint=sb://overcasb.servicebus.windows.net/;SharedSecretIssuer=owner;SharedSecretValue=wqYlT4yHZimeUZacH+1V1hj/ZrKu7zK9ELaaLYDxqjc=",
    "AssetMovement",
    "AssetMovement");
    I am getting the same error here also.
    "The token provider was unable to provide a security token while accessing 'https://overcasb-sb.accesscontrol.windows.net/WRAPv0.9/'.
    Error Code: 407 Proxy Authentication Required. The ISA Server requires authorization to fulfill the request. Access to the Web Proxy filter is denied. (12209)
    By setting  <defaultProxy useDefaultCredentials="true" /> in appconfig, I got rid of the above error. And now its working fine with .net(C#) client.
    <configuration>
      <system.net>
        <defaultProxy useDefaultCredentials="true" />
      </system.net>
    </configuration>
    The same setting I tried in BTSNTSvc.exe config file and ofcourse restarted the host instance but still getting the same error. Any help?
    gautam

  • Azure service bus queue: Why do I keep getting a MessageLockLostException?

    I read a post that dealt with the same problem I'm having. It is located at https://social.msdn.microsoft.com/Forums/en-US/069653b5-c233-4942-85b2-9eb50b3865c7/azure-service-bus-subscription-how-do-i-delete-the-message-when-i-receive-a?forum=servbus
    I'm calling message.Complete() and I'm getting the MessageLockLostException but the difference with my issue is that I used the code that someone posted to fix the issue and it isn't working for me. I have pasted my full code below to show you how my program
    is working. What am I doing wrong and/or how do I fix this issue?
    static void Main(string[] args)
    try
    string connectionString = CloudConfigurationManager.GetSetting("Microsoft.ServiceBus.ConnectionString");
    QueueClient client = QueueClient.CreateFromConnectionString(connectionString, "OoplesQueue");
    var actionBlock = new ActionBlock<BrokeredMessage>(async message =>
    await processCalculations(message),
    new ExecutionDataflowBlockOptions
    MaxDegreeOfParallelism = Environment.ProcessorCount
    var produceMessagesTask = Task.Run(async () => await
    ProduceBrokeredMessagesAsync(client,
    actionBlock));
    produceMessagesTask.Wait();
    catch (Exception ex)
    Console.WriteLine(ex.Message);
    Console.WriteLine(ex.StackTrace);
    private static async Task ProduceBrokeredMessagesAsync(QueueClient client,
    ActionBlock<BrokeredMessage> actionBlock)
    BrokeredMessage message;
    while ((message = await client.ReceiveAsync()) != null)
    await actionBlock.SendAsync(message);
    public static ConnectionMultiplexer connection;
    public static IDatabase cache;
    public static async Task processCalculations(BrokeredMessage message)
    var brokeredMessageRenewCancellationTokenSource = new CancellationTokenSource();
    try
    if (message != null)
    if (connection == null || !connection.IsConnected)
    connection = await ConnectionMultiplexer.ConnectAsync("connectionString");
    //connection = ConnectionMultiplexer.Connect("ConnectionString,SyncTimeout=10000,ConnectTimeout=10000");
    cache = connection.GetDatabase();
    var brokeredMessageRenew = Task.Run(async () =>
    while (!brokeredMessageRenewCancellationTokenSource.Token.IsCancellationRequested)
    //Based on LockedUntilUtc property to determine if the lock expires soon
    if (DateTime.UtcNow > message.LockedUntilUtc.AddSeconds(-10))
    // If so, we repeat the message
    await message.RenewLockAsync();
    }, brokeredMessageRenewCancellationTokenSource.Token);
    string sandpKey = message.Properties["sandp"].ToString();
    string dateKey = message.Properties["date"].ToString();
    string symbolclassKey = message.Properties["symbolclass"].ToString();
    string stockdataKey = message.Properties["stockdata"].ToString();
    string stockcomparedataKey = message.Properties["stockcomparedata"].ToString();
    var sandpTask = cache.GetAsync<List<StockData>>(sandpKey);
    var dateTask = cache.GetAsync<DateTime>(dateKey);
    var symbolinfoTask = cache.GetAsync<SymbolInfo>(symbolclassKey);
    var stockdataTask = cache.GetAsync<List<StockData>>(stockdataKey);
    var stockcomparedataTask = cache.GetAsync<List<StockMarketCompare>>(stockcomparedataKey);
    await Task.WhenAll(sandpTask, dateTask, symbolinfoTask,
    stockdataTask, stockcomparedataTask);
    List<StockData> sandp = sandpTask.Result;
    DateTime date = dateTask.Result;
    SymbolInfo symbolinfo = symbolinfoTask.Result;
    List<StockData> stockdata = stockdataTask.Result;
    List<StockMarketCompare> stockcomparedata = stockcomparedataTask.Result;
    StockRating rating = performCalculations(symbolinfo, date, sandp, stockdata, stockcomparedata);
    if (rating != null)
    saveToTable(rating);
    await message.CompleteAsync();
    else
    Console.WriteLine("Message " + message.MessageId + " Completed!");
    await message.CompleteAsync();
    catch (TimeoutException time)
    Console.WriteLine(time.Message);
    catch (MessageLockLostException locks)
    Console.WriteLine(locks.Message);
    catch (RedisConnectionException redis)
    Console.WriteLine("Start the redis server service!");
    catch (MessagingCommunicationException communication)
    Console.WriteLine(communication.Message);
    catch (Exception ex)
    Console.WriteLine(ex.Message);
    Console.WriteLine(ex.StackTrace);
    finally
    // Lock is stopped renewing task
    brokeredMessageRenewCancellationTokenSource.Cancel();

    Below check assumes there's no clock skew between you and the Service Bus server. If there's a time difference more than 10 seconds then you may end up with renew attempts after message expires.
    if (DateTime.UtcNow
    > message.LockedUntilUtc.AddSeconds(-10))
    And I suggest you to add a sleep in the renew loop. It's an overkill to make this check a million times every second. Doing this once a second should be fine.

  • Receive location using SBMessaging adapter disabled when Azure service bus is down

    Does anybody experience  SBMessaging receive locations are disabled when Azure service bus is unavailable with a MessagingCommunicationException?  Is this an expected behavior / 'by design'? We see this exception a few times a day.  I don't
    see any retry attempts based on the event log.  Our current solution is to have a powershell script that enables the receive location if it's disabled.  This script runs every 15 minutes.  Below is a sample of the error in the event log.
    The receive location "Warnings_SB_New" with URL "XXXXXX" is shutting down. Details:"System.ServiceModel.EndpointNotFoundException: Error during communication with Service Bus. Check the connection information, then retry. --->
    Microsoft.ServiceBus.Messaging.MessagingCommunicationException: Error during communication with Service Bus. Check the connection information, then retry. ---> System.ServiceModel.CommunicationObjectFaultedException: Internal Server Error: The server did
    not provide a meaningful reply; this might be caused by a premature session shutdown..TrackingId:bb29d71c-a4d5-430c-a2d9-8a2e3acfad1d, Timestamp:5/9/2014 2:38:19 AM

    Hi R. de Veen,
    Below as the script we used with BTS2013.  We created a command line and setup a scheduled task.  Again, we don't use this script with BTS2013R2 since we do not have this issue with BTS2013 R2.
    # Sample from https://github.com/tomasr/bts-ps-scripts/blob/master/bts-ports.ps
    # declare our parameters: the action to take
    param(
    [string] $action=$(throw 'need action'),
    [string] $name
    $ctpRLs = @(
    'Errors_SB_New'
    #,'Error_OldTopic_OldLoggingDB'
    ,'Information_SB_New'
    ,'Warnings_SB_New'
    #,'Information_NewTopic_OldLoggingDB'
    ,'Critical_SB_New'
    #'Critical_OldTopic_OldLoggingDB'
    # functions for pinging receive locations
    function uti-ping-recv-loc
    foreach ($rl in $ctpRLs)
    Write-Host "`n"
    if (( $rl -eq '') -or ($rl -eq $null))
    throw "Receive location cannot be blank."
    #Validate if this is a valid receive location
    $recvloc = get-wmiobject MSBTS_ReceiveLocation `
    -namespace 'root\MicrosoftBizTalkServer' `
    -filter "Name='$rl'"
    if ($recvloc -eq $null)
    Write-Host "'$rl' does not exist. Skipping..." -foregroundcolor red -backgroundcolor black
    else
    Write-Host "Ping '$rl'..."
    if ($recvloc.IsDisabled)
    Write-Host "Restarting '$rl'..."
    bts-set-recv-loc-status -name $rl -status 'enable'
    Start-Sleep -s 10
    if ($recvloc.IsDisabled)
    Write-Host "Failed to enable $rl. Check the event log for more information." -foregroundcolor red -backgroundcolor black
    else
    Write-Host "'$rl' is enabled."
    else
    Write-Host "'$rl' is enabled."
    $i++
    Write-Host "`nComplete!!!`n`n" -foregroundcolor green -backgroundcolor black
    # enable or disable the specified
    # receive location
    function bts-set-recv-loc-status($name, $status)
    $recvloc = get-wmiobject MSBTS_ReceiveLocation `
    -namespace 'root\MicrosoftBizTalkServer' `
    -filter "Name='$name'"
    switch ( $status )
    'disable' { [void]$recvloc.Disable() }
    'enable' { [void]$recvloc.Enable() }
    # controls a send port
    function bts-set-send-port-status($name, $status)
    $sendport = get-wmiobject MSBTS_sendPort `
    -namespace 'root\MicrosoftBizTalkServer' `
    -filter "Name='$name'"
    switch ( $status )
    'start' { [void]$sendport.Start() }
    'stop' { [void]$sendport.Stop() }
    'enlist' { [void]$sendport.Enlist() }
    'unenlist' { [void]$sendport.UnEnlist() }
    function is-valid-opt($check, $options)
    foreach ( $val in $options )
    if ( $check -eq $val ) {
    return $true
    # main script
    switch ( $action )
    'ping-recv-loc' {
    uti-ping-recv-loc
    Write-Host "`n"
    Write-Host "Syntax: .\RestartELCRLs.ps1 ping-recv-loc"
    Write-Host "`n"

  • I recently got a i phone 3 GS, how do I use applications now ? Do I need to buy some apple pack for apple services monthly ??

    I recently got a i phone 3 GS, how do I use applications now ? Do I need to buy some apple pack for apple services monthly ??

    You download apps from the App Store on your iPhone or iTunes from your computer.  If from the computer, you then sync them to your 3GS via iTunes.
    A few helpful links...
    http://www.apple.com/support/itunes/
    http://www.apple.com/support/iphone/
    http://manuals.info.apple.com/en_US/iphone_user_guide.pdf

  • Regarding Good book for Oracle Service Bus 11g

    Hi All,
    What is the good book for Oracle Service Bus 11g in the below list(or You can also specify any book other than from below list)?
    1)Oracle Service Bus 11g Development Cookbook
    2)Oracle Service bus in 21 days
    3)The definitive guide to SOA:Oracle Service Bus,Second edition (or)first edition?
    Can yOu help me out which is the good book for OSB?

    Hi Deilby,
    Thank You for your reply.
    According to my understanding(I don't know whether it is correct or not),If you want to have full-fledged OSB development,we need to have eclipse.
    If you just need to have routing and transformation along with SOA suite development,We can use OSB console .
    Can You also look into this below SOA forums thread with SOA-OSB questions? If I have 'Oracle
    Service Bus 11g Development Cookbook' , Can I answer all those questions?
    https://forums.oracle.com/thread/2559964?tstart=0
    My intention is clear,I want to have full-fledged OSB development information(important components) and that leads to have good exposure to face questions.
    Can You help me out to clarify my understanding and recommend the book according to that?
    Note: I already worked on SOA Suite.I worked on OSB console. I think whatever we can  do with OSB eclipse development the samething we can do with OSB console along with SOA suite.
    Can You clarify on this?

  • Workshop IDE for Oracle Service Bus

    Hi,
    I have installed Oracle WebLogic Server 11gR1 (10.3.3) + Coherence - Package Installer (downloaded from http://www.oracle.com/technology/software/products/ias/htdocs/wls_main.html). And I downloaded oepe from net for using it as IDE for Oracle service bus. But when i open the eclipse, i do not get any option for creating the oracle service project.
    Is there any plugin i need to put in eclipse for this to show up ??
    John

    You need to download Oracle Service BUs from here : This installer contains only OSB components and is not bundled with WLS and I think includes the eclipse plugins for Service bus projects.
    http://www.oracle.com/technology/software/products/osb/index.html
    There is a pre-requisite to download and install weblogic 10.3.3 + coherence +OEPE separately.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       

  • Restricting azure service bus access to certain IP range

    I am using service bus from two cloud services WebRoleC1 and WorkerRoleC2.
    on pushes some data and other received data by subscribing to topics.
    Every application maintains the service bus connection details in its web/cloud config. Everything works fine. 
    I have multiple instance running of the same application for different customers , people make confusion while deploying and Put wrong connection details in say WorkerRoleC2 so it connects to  Service bus of another customer. 
    I want to put restriction on service bus SB1 that only   WebRoleC1  and WorkerRoleC2 can connect to it. If WorkerRoleC3 has the proper key then also connection should fail.
    This also prevents people from attacking service bus if now public ip.
    I don't want service bus to publicly exposed.
    Thanks,
    Subodh

    Service Bus does allow you to restrict receive access to specific subscriptions. You can set credentials such that a client 1 can receive messages from a specific subscription whereas a client 2 cannot.

  • Sun idm adapter for Enterprise Service Bus (Using MQ)

    Hi
    Can you please let me know if any sun idm adapter support Enterprise Service Bus (Using MQ) ?
    Thanks

    As answer on question 1:
    No I never found any documentation from SAP that described a ESB solution. So al the knowledge must come from other vendors in your case from Sonic.
    But there is hope you can use XI in a ESB way. You must only (add) configure the ESB parts. This is done by adding a service repository for example the UDDI server in combination with some BPML engine.
    By adding it al together you can execute your business processes over multiple system platforms using SOAP in a synchronic way.
    This is the basic concept of a ESB.
    The answer to question 2.
    I don’t know if XI has build in support, but a know that there are free tools that can handle Canonical XML. So you can make a service your self to handle the Canonical XML documents.

  • Is SOA Suite replacement for Oracle Service Bus 10gR3 (10.3.1.0) ?

    I am confused if i have SOA Suite do I need Oracle Service Bus 10gR3 (10.3.1.0) for my ESB ?

    Right now there are eclipse plug-ins for OSB. In a default OSB installation you should have workshop installed with the OSB plug-ins.
    For the next release, OSB 11g, JDeveloper will incorporate these features.

  • Azure service bus problem : An error occurred while retrieving the Service Bus namespace configuration information

    Almost all of my service bus has the following issue. The error message I have from the Management Portal was "An error occurred while retrieving the Service Bus namespace configuration information. Please try again later." This happen for almost
    2 days.
    Anyone face the same issue? how to resolve this?

    Hi,
    If you create a new one, did you receive the same issue? If that, I suggest you submit a ticket at:
    http://www.windowsazure.com/en-us/support/contact/
    Best Regards,
    Jambor
    We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
    Click
    HERE to participate the survey.

  • Cannot create Azure Service Bus connector

    Hi,
    I tried to create a service bus connector. I did put in the connection string and the name of the queue, validation passed showing a green check. For the rest of the settings I just used default values given. The Create button is still disabled and
    it doesn't give any info as what's missing.
    Thanks,
    Paul

    Hi Paul - could you send us a screenshot of this? We'll take a look
    Thanks,
    Prashant

Maybe you are looking for

  • How to change net price of order in B2B webshop

    Hi All, I have a requirement where a new input field (discount) is to be added in 'order.jsp' page of B2B webshop in header level. when a user enters some discount in it and clicks 'update' button, the netprice in header should be reduced by given di

  • HT1199 When installing iTunes, I get message "Service 'Apple Mobile Device' failed to start.

    After getting the above error message, I ignore it.  The installation seems to continue fine.  Then when I start iTunes, I get the message "iTunes did not install properly Error 7 (Windows error 193).  I have updated the Microsoft .NET software to th

  • ? about transferring Intel iMac to new Intel iMac

    I'm considering a new iMac and am trying to find out if there is a way to duplicate my old drive onto the new drive (instead of using "migration assistant"). Can I create a full disk image of the old computer, then somehow transfer it to the new one?

  • Best practices export video with 5.1 surround sound

    I've created my first 5.1 FCPX project and would like to play on an Apple TV2 as well as a Windows 7 HTPC running Windows Media Center.  I've been trolling this and FCPX discussions and still having much difficulty.  I've exported Quicktime movie usi

  • How to make agency-level HTML banner ads

    I've done a ton of Flash banner ads at agency-level over the years, but I'm trying to figure out how to create html banners now, in addition. Here are the HTML Ad Spec requirements: - HTML code cannot exceed 3k - 2 images maximum, total file size of