Table storage got 4 times slower from day to day
Hi, I've run tasks which added data to the table storage on my cloudapp each night for the last months, but since Friday 13th (yeah 13th, thats what I thought), the tasks have been executing 4 times slower.
The exact Work being done, is around 250,000 calls to 'ExecuteBatch' split up on three workers - thursday I got around 20 ops, and since Friday I've been getting around 5 ops. See the storage graph below. It clearly shows that the requests has dropped
significantly...
Does the azure table storage limit bandwidth in some cases, or what could have happened?
Has anyone experienced this or something similar before?
Hi APMadsen,
I guess the azure table storage may be affected by larger and larger data. If so, I suggest you could pay attention to your query code and spend on the query code optimization (refer to this thread
http://social.msdn.microsoft.com/Forums/windowsazure/en-US/5326d280-513f-47a3-826d-2db97ebd9ace/why-is-this-azure-table-storage-query-so-slow). Also, I suggest you could refer to this big data sample (http://www.troyhunt.com/2013/12/working-with-154-million-records-on.html
) and this blog (http://robertgreiner.com/2012/06/why-is-azure-table-storage-so-slow/ ).
Hope it helps.
Will
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.
Similar Messages
-
Azure Storage access 2 times slower on some Azure machines
I have 3 differents subscription. (let's call it SubA, SubB, SubC)
My storage is on SubA.
I created 1 VM on SubA, one on SubB, one on SubC.
I tried any combination of Location, Affinity group, and VM Size. The result is always the same :
On SubA and SubB, the azure throughput of the following code is 2000 Transaction/S
The VM on SubC, it is consistently 6000 Transaction/S.
Here is the code :
internal static void SetThrottling()
ServicePointManager.UseNagleAlgorithm = false;
ServicePointManager.Expect100Continue = false;
ServicePointManager.DefaultConnectionLimit = 100;
private static void Azure()
SetThrottling();
var client = IndexerConfiguration.FromConfiguration().CreateBlobClient();
var container = client.GetContainerReference("throughput2");
container.CreateIfNotExists();
int count = 0;
var threads = Enumerable.Range(0, 30).Select(_ => new Thread(__ =>
while (true)
var testStream = new MemoryStream(new byte[] { 1, 2, 3, 4, 5, 6 });
// Create a random blob name.
string blobName = string.Format("test-{0}.txt", Guid.NewGuid());
// Get a reference to the blob storage system.
var blobReference = container.GetBlockBlobReference(blobName);
// Upload the word "hello" from a Memory Stream.
blobReference.UploadFromStream(testStream);
// Increment my stat-counter.
Interlocked.Increment(ref count);
})).ToArray();
foreach (var test in threads)
test.Start();
while (true)
Thread.Sleep(2000);
Console.WriteLine(count + " / s");
Interlocked.Exchange(ref count, 0);
Result on SubA :
Result on SubC :
SubC results is independant of the Location and VM Size, as for SubA and SubB.
Tests are done on plain newly created empty VM.
Any idea ?
The only difference I have seen is that SubC is maybe not a Bizpark subscription, whereas the two previous are. (Test environment)Hi,
Thank you for reaching out to us.
I am currently researching to gather more information with regards to your request.
I shall revert back to you with an update at the earliest.
Sincerely appreciate your patience.
Regards,
Shirisha Paderu -
Super slow from day one Broadband.
Having changed from Tiscali a few weeks ago having a constant 4/5m+mb ...was promised better things by the BT gent on the phone....but since changing highest speed ever barely 1mb how frustrating is that ....Helpppppppppppppppp ?
[url=http://www.thinkbroadband.com/speedtest/results/id/128514100865683727648.html][img]http://www.thinkbroadband.com/speedtest/button/128514100865683727648.png[/img][/url]
this tester same as BT,s one up and down less than 1mb constantly.<script src="x-javascript/image.handler.js" type="text/javascript"></script> <script src="x-javascript/starttest.js" type="text/javascript"></script> <script src="x-javascript/speed.test.js" type="text/javascript"></script> <script src="x-javascript/cookie.js" type="text/javascript"></script> <script></script>
FAQ
<script></script> Test1 comprises of two tests
1. Best Effort Test: -provides background information.
Download Speed
1009 Kbps
0 Kbps
1000 Kbps
Max Achievable Speed
Download speedachieved during the test was - 1009 Kbps
For your connection, the acceptable range of speedsis 200-1000 Kbps.
Additional Information:
Your DSL Connection Rate :9720 Kbps(DOWN-STREAM), 1160 Kbps(UP-STREAM)
IP Profile for your line is - 1000 Kbps
The throughput of Best Efforts (BE) classes achieved during the test is - 18.53:19.98:61.49 (SBE:NBEBE)
These figures represent the ratio while sententiously passing Sub BE, Normal BE and Priority BE marked traffic.
The results of this test will vary depending on the way your ISP has decided to use these traffic classes.
2. Upstream Test: -provides background information.
Upload Speed
872 Kbps
0 Kbps
1160 Kbps
Max Achievable Speed
>Upload speed achieved during the test was - 872 Kbps
Additional Information:
Upstream Rate IP profile on your line is - 1160 Kbps
We were unable to identify any performance problem with your service at this time.
It is possible that any problem you are currently, or had previously experienced may have been caused by traffic congestion on the Internet or by the server you were accessing responding slowly.
If you continue to encounter a problem with a specific server, please contact the administrator of that server in the first instance.
Please visit FAQ section if you are unable To understand the test results.
<script src="x-javascript/wz_tooltip.js" type="text/javascript"></script>
Notes:
The Download Speed is the average rate that was achieved during this test.
Notes:Your line is configured to the maximum rate that it can support or at your chosen fixed rate, this is known as the line rate and would be viewed through your CPE software or in your router configuration.
Your IP profile is always less than the line rate and is normal on any network.
The Upstream Test rate figure quoted will always be smaller than the assured rate profile. This is because in order for the throughput to reach its destination, it requires an overhead which explains the difference between the two.
Notes:
If your download speed lies in this range then your connection seems to be working fine.
Notes:
The Download Speed is the average rate that was achieved during this test.
Notes:Your line is configured to the maximum rate that it can support or at your chosen fixed rate, this is known as the line rate and would be viewed through your CPE software or in your router configuration.
Your IP profile is always less than the line rate and is normal on any network.
<script></script> <script src="x-javascript/wz_tooltip.js" type="text/javascript"></script> <script src="x-javascript/continue.js" type="text/javascript"></script> -
HI
I created a web application and configured rbs storage ,
I uploaded documents (for ex: 18 number)
after uploaded documents , and observed the RBS storage folder, number of files are increasing (39 number) , its working fine
and also I run the querys to check the rows increasing or not , (when I upload new doc rows are increased its fine also)
select count(*) from alldocs
Select count(*) from AllDocstreams
but when I delete some docs from document library ,
1)the doc itself deleted from document library
2)when I check the rbs storage there is no number of files are decreased(its still 39 files ), its same as before doc deleted from doc library
after some time I found the number of files are decreasing from RBS storage folder in sql server,
here I want to know the how the files are decreasing from RBS storage after some time, where shld I check the settings for this? and how I control on it
here how I know the settings for cleaning up orphan BLBOS how these deleted BLOB
adil1. WHen you delete the file from Sharepoint, it is still present in Recycle bin. This is a default setting in sharepoint for 30 days. Once files are deleted fro Recycle bin, it can also be delete from RBS
2. There is a RBS cleanup job which deletes files from RBS. for more info check
http://mehuljamod.blogspot.in/2012/09/remote-blob-storage-maintainer-rbs.html -
I recently purchased FaceTime from the Application Store. After approx. ±10 meg, the application resets and starts downloading again. I have tried to download it at different times of the day but with the same results. I have been in contact with Apple support and have tried different options with the same result. I cannot download a new Version because in my Purchased List the applicaiton (FaceTime) is still there, and because I have halted it it tells me to resume. I can’t, because the same thing is going to happen. I have tried all the various troubleshooting tips supplied by my ISP and also Apple Support with no luck. I am currently working on a IMac OS 10.6.7. Has anybody got any ideas? Any suggestion would help. Thanks
Amol Soni wrote:
As I said, I tried everything what the manual says, but hard luck. I have taken an appointment for today, lets see what happens.
Also there is no activity on unit when I use the remote. The unit is stuck on the first page itself where we have to choose the language. The unit seems to be fine to me but the real problem is remote does'nt have activity. The IR is not responding while pressing any of the button.
Good luck with your appointment.
Not much consolation but even new products can have issues and might need a trip to a store to return/replace.
The reason i asked about the LED on the AppleTV is that occasionally it thinks it's paired with a specific remote and ignores others - the unpair keypress I described is quick and free.
AC -
Two problems, disconnecting and extremely slow internet at a certain time of the day.
My first problem started to occur since the beginning of this year, after I've upgraded from 1MB/s to 3MB/s. EVERYDAY at 2:39 PM EST or sometime around there, my internet would disconnect (most common at 2:39). It would take some 5-20 minutes to reconnect by itself. I go to 192.168.1.1 and go to broadband connection and press disconnect, then reconnect to get myself back on asap. It would take me a few tries disconnecting and connecting to get the internet back up. I probably do disconnect during other times of the day, such as night time but I don't notice it as much because I am not using the computer at the time.
My second problem is slow download speed at night. As I said, I have a 3000/667 kb/s connection. My internet connection speed is normal during the day time .. but when I ran a speed test during night time, I get around 333 kb/s download and 600 kb/s upload. So, my download speed drops significantly at night and my upload speed is normal.
I am using a D90-327W15-06 modem and I am not using a wireless connection.
Margin (dB) 14.5 11.0
Line Attenuation (dB) 40.0 23.0
Transmit Power (dBm) 18.4 11.9
Don't know if that information helps ..
P.S Sorry if this is a lot to read, I wanted it to be as much detailed as possible.#1 Is wireless in the router enabled?
#2 If so, to question number one above: What level of wireless security is it set to ( WEP / WPA )?
#3 Did you try connecting your modem to the NID?
If not, please do that - and recheck those stats.
If you do not what a NID is, see http://www.dslreports.com/faq/1317
If you are the original poster (OP) and your issue is solved, please remember to click the "Solution?" button so that others can more easily find it. If anyone has been helpful to you, please show your appreciation by clicking the "Kudos" button. -
How to select data from AZure table storage without row key and partition key
Hi
I need to select a data from azure table storage without rowkey and partition key. how in azure storage emulator click query it display all data from that table.
thanks
rajeshHi rajesh,
It seems that you didn't click query data using storage emulator. But I recommend you could use the azure server explore in your VS to view your data and query data. Please see this document (http://msdn.microsoft.com/en-us/library/azure/ff683677.aspx).
And base on my experience, you may need input the command on Azure storage emulator, such as this page(http://msdn.microsoft.com/en-us/library/azure/gg433005.aspx).
Regards,
Will
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey. -
i got my i phone4s few days back and i created an apple id with a credit card and when i go to the appstore to purchase apps,all have and message stating that "this app is no longer available"..how do i fix this issue?im from singapore by the way
If it is longer available then you can't get the app on your phone.
-
My cell phone will not back up properly to my laptop. I have tried three times in two days as I knew I was getting my new phone today and wanted to save all my information. The problem is that it backed up very random things like things from my IPod from years ago, and did not back up all the information it should have from my "old" cell phone. Now I am missing almost everything. What happened and can i fix this?
First, make sure you are using the most current version of iTunes 11.1.3 (8). Second, what version of iOS 7 was your old phone running, i.e. 7.0, 7.0.1, 7.0.2? If your back-up was made with a version of iOS that is newer than the version on your new phone, it will not sync. For example, if your back-up was of a phone running iOS 7.0.4, and your new phone was running 7.0.2 out of the box, the back up will not sync to the new phone until it is updated to iOS 7.0.4.
-
Fatch data from a table after a given time interval
Hello
I want to fetch date from a table after a fixed time interval is there any
way to do it.
thanksNot sure what you want. But maybe this helps.
SELECT date+interval FROM atable;
Also if you tell us more about the business case the answers could be more to the point. -
Function Module Extraction from KONV Table taking lot of time for extractio
Hi
I have a requirement wherein i need to get records from KONV Table (Conditions (Transaction Data) ). i need the data corresponding to Application (KAPPL) = 'F'.
For this i had written one function module but it is taking lot of time (@ 2.5 hrs) for fetching records as there are large number of records in KONV Table.
I am pasting the Function Module code for reference.
<b>kindly guide me as to how the extraction performance can be improved.</b>
<b>Function Module Code:</b>
FUNCTION ZBW_SHPMNT_COND.
""Local interface:
*" IMPORTING
*" VALUE(I_REQUNR) TYPE SBIWA_S_INTERFACE-REQUNR
*" VALUE(I_ISOURCE) TYPE SBIWA_S_INTERFACE-ISOURCE OPTIONAL
*" VALUE(I_MAXSIZE) TYPE SBIWA_S_INTERFACE-MAXSIZE OPTIONAL
*" VALUE(I_INITFLAG) TYPE SBIWA_S_INTERFACE-INITFLAG OPTIONAL
*" VALUE(I_UPDMODE) TYPE SBIWA_S_INTERFACE-UPDMODE OPTIONAL
*" VALUE(I_DATAPAKID) TYPE SBIWA_S_INTERFACE-DATAPAKID OPTIONAL
*" VALUE(I_PRIVATE_MODE) OPTIONAL
*" VALUE(I_CALLMODE) LIKE ROARCHD200-CALLMODE OPTIONAL
*" TABLES
*" I_T_SELECT TYPE SBIWA_T_SELECT OPTIONAL
*" I_T_FIELDS TYPE SBIWA_T_FIELDS OPTIONAL
*" E_T_DATA STRUCTURE ZBW_SHPMNT_COND OPTIONAL
*" E_T_SOURCE_STRUCTURE_NAME OPTIONAL
*" EXCEPTIONS
*" NO_MORE_DATA
*" ERROR_PASSED_TO_MESS_HANDLER
The input parameter I_DATAPAKID is not supported yet !
TABLES: KONV.
Auxiliary Selection criteria structure
DATA: l_s_select TYPE sbiwa_s_select.
Maximum number of lines for DB table
STATICS: l_maxsize TYPE sbiwa_s_interface-maxsize.
Maximum number of lines for DB table
STATICS: S_S_IF TYPE SRSC_S_IF_SIMPLE,
counter
S_COUNTER_DATAPAKID LIKE SY-TABIX,
cursor
S_CURSOR TYPE CURSOR.
Select ranges
RANGES: L_R_KNUMV FOR KONV-KNUMV,
L_R_KSCHL FOR KONV-KSCHL,
L_R_KDATU FOR KONV-KDATU.
Declaring internal tables
DATA : I_KONV LIKE KONV OCCURS 0 WITH HEADER LINE.
DATA : Begin of I_KONV occurs 0,
MANDT LIKE konv-mandt,
KNUMV LIKE konv-knumv,
KPOSN LIKE konv-kposn,
STUNR LIKE konv-stunr,
ZAEHK LIKE konv-zaehk,
KAPPL LIKE konv-kappl,
KSCHL LIKE konv-kschl,
KDATU LIKE konv-kdatu,
KBETR LIKE konv-kbetr,
WAERS LIKE konv-waers,
END OF I_KONV.
Initialization mode (first call by SAPI) or data transfer mode
(following calls) ?
IF i_initflag = sbiwa_c_flag_on.
Initialization: check input parameters
buffer input parameters
prepare data selection
The input parameter I_DATAPAKID is not supported yet !
Invalid second initialization call -> error exit
IF NOT g_flag_interface_initialized IS INITIAL.
IF
1 = 2.
MESSAGE e008(r3).
ENDIF.
log_write 'E' "message type
'R3' "message class
'008' "message number
' ' "message variable 1
' '. "message variable 2
RAISE error_passed_to_mess_handler.
ENDIF.
Check InfoSource validity
CASE i_isource.
WHEN 'X'.
WHEN 'Y'.
WHEN 'Z'.
WHEN OTHERS.
IF 1 = 2. MESSAGE e009(r3). ENDIF.
log_write 'E' "message type
'R3' "message class
'009' "message number
i_isource "message variable 1
' '. "message variable 2
RAISE error_passed_to_mess_handler.
ENDCASE.
Check for supported update mode
CASE i_updmode.
For full upload
WHEN 'F'.
WHEN 'D'.
WHEN OTHERS.
IF 1 = 2. MESSAGE e011(r3). ENDIF.
log_write 'E' "message type
'R3' "message class
'011' "message number
i_updmode "message variable 1
' '. "message variable 2
RAISE error_passed_to_mess_handler.
ENDCASE.
APPEND LINES OF i_t_select TO g_t_select.
Fill parameter buffer for data extraction calls
g_s_interface-requnr = i_requnr.
g_s_interface-isource = i_isource.
g_s_interface-maxsize = i_maxsize.
g_s_interface-initflag = i_initflag.
g_s_interface-updmode = i_updmode.
g_s_interface-datapakid = i_datapakid.
g_flag_interface_initialized = sbiwa_c_flag_on.
Fill field list table for an optimized select statement
(in case that there is no 1:1 relation between InfoSource fields
and database table fields this may be far from beeing trivial)
APPEND LINES OF i_t_fields TO g_t_fields.
Interpretation of date selection for generic extraktion
CALL FUNCTION 'RSA3_DATE_RANGE_CONVERT'
TABLES
i_t_select = g_t_select.
ELSE. "Initialization mode or data extraction ?
CASE g_s_interface-updmode.
WHEN 'F' OR 'C' OR 'I'.
First data package -> OPEN CURSOR
IF g_counter_datapakid = 0.
L_MAXSIZE = G_S_INTERFACE-MAXSIZE.
LOOP AT g_t_select INTO l_s_select WHERE fieldnm = 'KNUMV'.
MOVE-CORRESPONDING l_s_select TO l_r_knumv.
APPEND l_r_knumv.
ENDLOOP.
LOOP AT g_t_select INTO l_s_select WHERE fieldnm = 'KSCHL'.
MOVE-CORRESPONDING l_s_select TO l_r_kschl.
APPEND l_r_kschl.
ENDLOOP.
Loop AT g_t_select INTO l_s_select WHERE fieldnm = 'KDATU'.
MOVE-CORRESPONDING l_s_select TO l_r_kdatu.
APPEND l_r_kdatu.
ENDLOOP.
*In case of full upload
Fill field list table for an optimized select statement
(in case that there is no 1:1 relation between InfoSource fields
and database table fields this may be far from beeing trivial)
APPEND LINES OF I_T_FIELDS TO S_S_IF-T_FIELDS.
OPEN CURSOR G_CURSOR FOR
SELECT MANDT
KNUMV
KPOSN
STUNR
ZAEHK
KAPPL
KSCHL
KDATU
KBETR
WAERS
FROM KONV
WHERE KNUMV IN l_r_knumv
AND KSCHL IN l_r_kschl
AND KDATU IN l_r_kdatu
AND KAPPL EQ 'F'.
ENDIF.
Refresh I_KONV.
FETCH NEXT CURSOR G_CURSOR
APPENDING CORRESPONDING FIELDS OF TABLE I_KONV
PACKAGE SIZE S_S_IF-MAXSIZE.
IF SY-SUBRC <> 0.
CLOSE CURSOR G_CURSOR.
RAISE NO_MORE_DATA.
ENDIF.
LOOP AT I_KONV.
IF I_KONV-KAPPL EQ 'F'.
CLEAR :E_T_DATA.
E_T_DATA-MANDT = I_KONV-MANDT.
E_T_DATA-KNUMV = I_KONV-KNUMV.
E_T_DATA-KPOSN = I_KONV-KPOSN.
E_T_DATA-STUNR = I_KONV-STUNR.
E_T_DATA-ZAEHK = I_KONV-ZAEHK.
E_T_DATA-KAPPL = I_KONV-KAPPL.
E_T_DATA-KSCHL = I_KONV-KSCHL.
E_T_DATA-KDATU = I_KONV-KDATU.
E_T_DATA-KBETR = I_KONV-KBETR.
E_T_DATA-WAERS = I_KONV-WAERS.
APPEND E_T_DATA.
ENDIF.
ENDLOOP.
g_counter_datapakid = g_counter_datapakid + 1.
ENDIF.
ENDFUNCTION.
Thanks in Advance
Regards
Swapnil.Hi,
one option to investigate is to select the data with a condition on KNUMV (primary IDX).
Since shipment costs are store in VFKP I would investigate if all your F condition records are used in this table (field VFKP-KNUMV).
If this is the case then something like
SELECT *
FROM KONV
WHERE KNUMV IN (SELECT DISTINCT KNUMV FROM VFKP)
or
SELECT DISTINCT KNUMV
INTO CORRESPONDING FIELD OF <itab>
FROM VFKP
and then
SELECT *
FROM KONV
FOR ALL ENTRIES IN <itab>
WHERE...
will definitively speed it up.
hope this helps....
Olivier -
How do I get a time value in days, hours and minutes returned to a cell from a calculation of distance divided by speed?
Simon,
you can use the duration function:
B4=DURATION(0,0,B1/B2)
you can further, format the cell as a duration like this using the cell inspector: -
hello actually I have purchased my iPod touch 4 generation 1 month back.initially I find that it's battery life is superb.it works for 5 -6 days in standby and 8-9 hrs usage time but from past 2days its battery is draining very fast I have to charge it twice a day.i m using iOS 6.0.1.plz suggest me what to do??its just 1 month old ..I have spend lot of money to buy it, I don't want it like that..plz reply.....
Try:
- Reset the iOS device. Nothing will be lost
Reset iOS device: Hold down the On/Off button and the Home button at the same time for at
least ten seconds, until the Apple logo appears.
- Then see if placing the iPod in airplane mode when in standby helps.
- Reset all settings
Go to Settings > General > Reset and tap Reset All Settings.
All your preferences and settings are reset. Information (such as contacts and calendars) and media (such as songs and videos) aren’t affected.
- Restore from backup. See:
iOS: How to back up
- Restore to factory settings/new iOS device.
- Make an appointment at the Genius Bar of an Apple store.
Apple Retail Store - Genius Bar -
How can I get updates for Photoshop CS5 to download to my new Mac book pro where CS5 is already installed from my original disk? I have tried many times over 2 days. I get the same error messages re downloading error. I successfully downloaded the current version of Adobe DNG Converter & it installed perfectly. Help please!
The Adobe auto updater is highly unreliable.
You need to look for and download the update yourself and then manually apply it as per the detailed instructions on the download page:
Adobe - Photoshop : For Macintosh
~~~~~~~~~~~~~~~~~~~~~~
Please note that the Adobe Camera Raw plug-in must be updated separately, after you have updated Photoshop:
Adobe - Adobe Camera Raw and DNG Converter : For Macintosh -
i got my iphone 5c from like 4 month ago and the last two days the battery lose charge from 100% to 80% while 30 minut without even using it
First you need to back up you iPhone.
Then http://support.apple.com/kb/ht1414
Maybe you are looking for
-
Component Video to Scart Cable
Hello Has anyone in the UK tried to connect an Apple TV to regular TV with Scart? Component Video to Scart Cables cabled can be bought for around £20, has anyone tried this with success? I'd welcome comments.
-
How do I fade one frame into another?
In Flash pro 4 how do I fade out of one keyframe and fade into the next one with a slow transition? thanks.
-
Use TV as 2nd screen thru apple TV
Hi, I just bought a apple TV, and I want to use it not only to share photos etc.. but also as a real 2nd screen: i.e. just as my powerbook screen, is that possible? cheers and thank you for any info T
-
Input on a PKGBUILD appreciated
I found myself in need of a software package that were not in the repos nor in aur, but instead of just compile and be done with it I made it into a package, as practice. There are some issues that made it harder to package, for me: The source archiv
-
InstrumentLoggerImpl.doInstrumentForWeb Error
Good Afternnon, I have been trying to install our app using the JAVKE 1.4 tools and hence getting it up and running on the App server. We have run into a whole pile of glitches along the way including conflicts with IIS trying to get the Server start