Disctinct count supported in MDX?

I would like to know whether Distinct count supported in MDX statements.
I tried below MDX statement. But it just perform Count() function.
<EXPRESSION>COUNT(DISTINCT([0MATERIAL].[LEVEL01].MEMBERS),ExcludeEmpty)</EXPRESSION>

Hi,
If you are creating Custom Objects in an OLAP universe (using XML and MDX) then there is a formula editor with a expression wizard .
This will tell you which MDX functions you can use against SAP BW / BEX
For example, here is a list of MDX functions you can use with MS Analysis Services : http://msdn.microsoft.com/en-us/library/ms145970.aspx
this will be different from those available for BW, mainly due to internal limitations in the MDXInterface
Regards,
H

Similar Messages

Performance counter for BTS 2010

As per below link BizTalk 2006 shipped with 294 performance counters.
http://blogs.technet.com/b/clint_huffman/archive/2008/09/02/how-to-use-the-pal-tool-for-biztalk-performance-analysis.aspx
Howmany performance counter supported by BTS 2010?

If you are looking for performance counters for 2010, here is the msdn link -
msdn.microsoft.com/en-us/library/aa578394.aspx

SAP Variable Tech Name in MDX

Hi Friends,
I have a question related to SAP Variable usage in MDX statement.
I have a hierarchy node variable, which is mandatory and has a default value..
When technical name of this variable is something like ZXYZ_SM, it appears differently in MDX, as !V0000017..
Problem is, i have to use this variable in two seperate queries and this MDX technical name changes query to query..
Eg.: when it is !V0000017 in Query A, it is !V0000015 in Query B.. I need them to be identical across queries, because this is a global filter of a huge dashboard..
Can you please help me how to proceed? I need solution on Bex side..
Thanks in advance,
Sunil
====================================================
SAP Variable tech name needs to be shorter than 10 chars in order to be supported by MDX. So, changing variable name fixed the issue...
====================================
Edited by: SunilKmr on Nov 29, 2010 1:27 PM

What Rohit is trying to say is that the technical name of the BEX variables is not shown to an end user,
and also not used to combine user input, only the prompt text is.
(BTW, the technical name is determined by the position of the variable prompt in the BEX query,
so the first variable shown will be !V000001, the second !V000002, etc.
So in your case the order in the two BEX queries is different)
So if you have two BEX queries, this means two universes.
Now when you want to report data out of these two universes you will build a query in the WebI report on each universe.
Both queries will ask you for input for their respective BEX variables,
but to do that they using the prompt text, not the tech name.
By default this prompt text will be the name of the BEX variable,
but you can change the text in the universe without implications.
As long as the two prompt texts are the same for these two different tech name variables,
BO will give just one prompt and feed it to !V0000017 in the query on the universe for BEX query A
and !V0000015 in the query on the universe for BEX query B.
Hope this is clear enough,
Marianne

MDX Properties function

I use ADOMD/MDX to query data against SAP BW.
Can any BW expert answer me whether BW support MDX Properties function. That is, Does BW support a MDX as following:
Select Filter([CProduct].Members,[CProduct].CurrentMember.Properties("2CCOLOR")="RED") On Columns From [$CSale]
Thanks in advance.

In NW you can't use property values in equations...the answer is to hard code in the logic or use a BADI to retrieve the property value and execute the equation. Please see my answer to the following threads
[Re: Select Distinct]
[Re: Script logic question]

What query languages are supported by SSAS?

Hi there,
I am currently writing a paper on Microsoft SSAS and I was wondering if I could ask the Microsoft moderators and the community for some information concerning the languages supported by SSAS.
I understand that SSAS supports both MDX for multidimensional and DAX for tabular models. Hoever, can I use any other language to query data?
For instance? Is it fair to sayt that I could I use T-SQL to query data? If so, do I need to have a specific storage mode configured (i.e.: ROLAP) or could I use T-SQL for queries regardless if I am using ROLAP, HOLAP or even MOLAP?
Also, is it correct to include LINQ in this category, as well as XML for analysis?
If you could provide some literature in your answer that would be great (but no sweat if you can't).
Best Regards,
P.

Yes, the dialect of SQL supported is very, very limited.
Don't forget that SSAS also supports DMX for data mining. You can also use this to query your cube, but again it's not pretty - see
http://cwebbbi.wordpress.com/2009/05/20/joining-the-results-of-two-mdx-queries-together/ for example.
Regarding LINQ, there's at least one third-party product that allows you to use it on top of cubes:
http://www.agiledesignllc.com/Products.htm
Finally, the very latest versions of SSAS 2012 Multidimenionsional can be queried with DAX as well as MDX (which means that both Tabular and Multidimensional models can be queried with either DAX or MDX):
http://cwebbbi.wordpress.com/2013/06/02/analysis-services-multidimensional-now-works-with-power-viewand-why-thats-important/
Chris
Check out my MS BI blog I also do
SSAS, PowerPivot, MDX and DAX consultancy
and run public SQL Server and BI training courses in the UK

MDX OLAP Universe does not allow for a Top 10 rank on measure.

Hello!
I am trying to Rank a measure by Top 10 in count on a MDX OLAP universe based on Web Intelligence. The rank works, however for all the zeros in the row values it gives the same rank and keeps on appending. I then tried to rank a measure with the MDX syntax in the SELECT statement of the measure itself. The syntax is as below:
<EXPRESSION>Rank([0MATERIAL__0MATL_GROUP].[LEVEL01].CurrentMember,
Order([0MATERIAL__0MATL_GROUP].[LEVEL01].CurrentMember.Level.Members
@Select(Exp Dem (Published)\Exp Dem (Published)),
@Prompt(u2018Top orBottomu2019,u2019Nu2019,{u2018DESCu2019,u2019ASCu2019},mono,constrained) ) )</EXPRESSION>
The XML is parsed because of the tags, however when using this measure in the query panel gives an error message for the prompt. Is there a way to rank a measure by Top 10 in the MDX statement above instead of the prompt for the Top/Bottom. I found the syntax in the OLAP Best practices guide.
Kindly revert for any possible solution. Any inputs are highly appreciated.
Thanks in advance!
Regards,
Vivek.
P.S.: I am specifically looking to Rank multiple measures by Top 10 count without displaying zeros / repetetive values.

Hi Ingo!
Thank you for responding! I have gone through the OLAP Universe best practices as suggested by the guide. However, the Ranking has an offset of repeating the ranks for same value metrics. So if I need a Top 10 and there are 3 zero values in the column, the ranking extends to Top 13. is there any way to hardcode this as a predefined filter in the Universe on the measure, which states that the rank stays limited to Top 10 irrespective of repeating values?
Kindly suggest if there is a work around for this!
Thanks in advance!
Regards,
Vivek.

Count Distinct Over Partition Syntax Error

Count(Distinct [field]) over (partition by [field2]) returns a syntax error at the key word distinct
Count(all [field]) over (partition by [field2]) compiles fine
I am writing a query to count the number of clients a sales rep has when the sales rep represents multiple companies (ad agency). I need a count of the clients each company has and a distinct count that each rep has. A client may be assigned to multiple companies.
Is a distinct count supported with partitions?

Until we wait for the full implementation of the OVER clause, you can
try something like this:
CREATE TABLE Foo (
fookey INT PRIMARY KEY,
company VARCHAR(30),
sales_rep VARCHAR(30),
client VARCHAR(30));
INSERT INTO Foo VALUES(1, 'ABC Corp.', 'Joe', 'Client1');
INSERT INTO Foo VALUES(2, 'ABC Corp.', 'Joe', 'Client2');
INSERT INTO Foo VALUES(3, 'ABC Corp.', 'Peter', 'Client2');
INSERT INTO Foo VALUES(4, 'DEF Corp.', 'Joe', 'Client1');
INSERT INTO Foo VALUES(5, 'DEF Corp.', 'Joe', 'Client3');
SELECT fookey, company, sales_rep, client,
MAX(rk1) OVER(PARTITION BY sales_rep) AS rep_distinct_client_cnt,
MAX(rk2) OVER(PARTITION BY company) AS company_distinct_client_cnt
FROM (
SELECT fookey, company, sales_rep, client,
DENSE_RANK() OVER(PARTITION BY sales_rep ORDER BY client) As rk1,
DENSE_RANK() OVER(PARTITION BY company ORDER BY client) As rk2
FROM Foo) AS F;
fookey company sales_rep client rep_distinct_client_cnt
company_distinct_client_cnt
1 ABC Corp. Joe Client1 3 2
2 ABC Corp. Joe Client2 3 2
3 ABC Corp. Peter Client2 1 2
4 DEF Corp. Joe Client1 3 2
5 DEF Corp. Joe Client3 3 2
Plamen Ratchev
http://www.SQLStudio.com

Cisco LWAP client count concentration

Hello
I have an environment of Cisco 5508 Wireless Controller and 1142N Access Points. I have a problem with the ratio of concentration of clients connecting to Access points in floors.
Recently I have been turning off 802.11a on the access points and I am seeing increase in client count in a few of acces points.
Here is the snapshot..
What is the maximum client count supported by these access points and how do i ensure they are distributed evenly on access points?
thanks

Can you elaborate on your intentions again?
You are saying that you are shutting off A radios (5Ghz) and expecting to improve the performance of 2.4Ghz?
Generally speaking, the more you move off of 2.4Ghz toward 5Ghz, the better your 2.4Ghz performance will be (less is more). If you have any dual-band clients, most people would be looking to get those clients onto the 5Ghz (A) Radio which is where the Band Select feature comes in to play....
I guess I'm just not following the logic of disabling 5Ghz radios....
If you're trying to improve performance, I'd chose Band Select over Load-Balancing, in an attempt to move clients over to 5Ghz. If your clients are only b/g/n (2.4Ghz) then thats a non issue, and load-balancing would distribute clients across the APs but it comes with an expense of potentially slower roams...

YTD, MTD, Prior Year, Prior Month calculations in SAP BW Universe

I am finding the SAP BW based universe a totally different animal so far and my question comes from my inexperience in this domain.
In a normal universe, one can use CASE Statement and Calendar or Time table to help do these calculations. Since BW based universes are based on a super BEx query, how are these calculations done in the universe? Are these calculations done in the BEx query itself?
Are there any standards of what should be handled on the BEx side vs. what should be handled on the Universe side?
Also, what's the syntax of a CASE statment or using Substring (or similar function) in a BW universe?
Thanks!

Hi,
You can define calculated measures in OLAP universes using MDX language.
To define a Calculated Measure, users must create manually new Measures in the Universe.
Calculated Measures definitions are using MDX functions embedded in XML tags.
In order to create calculated measures, users must to create pure MDX expression emclosed in XML tags: <EXPRESSION></EXPRESSION>
In this new expression, we authorize to use any Designer function such as:
u2022     @SELECT
u2022     @PROMPT
u2022     @VARIABLE
The check integrity will validate the XML syntax and any of the Designer functions described above.
No MDX parser is provided in this version of Universe Designer.
This paragraph describes how to define calculated measures in MDX and using @Select and @Prompt functions.
CASE statement is not supported in MDX but you can use IIF statement instead of.
It is important to notice that the result of a calculated measure/member in SAP BW (using MDX) must be numeric due to a current limitation f the SAP MDX engine.
Here is 2 samples of an MDX expression using YTD:
    <EXPRESSION>
SUM(YTD(@Select(Key Figures\Billed Quantity
</EXPRESSION>
    <EXPRESSION>
SUM(YTD([Measures].[D3B1M57O3MN5499LF2X9UNHKA]))
</EXPRESSION>
Regards,
Didier

How to relate current day to date hierarchy [year - month - day] for SSRS report paramenter

Hi there:
I've created a SSRS report based on OLAP cube. In this report, there is a date parameter which is used to filter out data.
Now , I want this report to be run and always retrieve data from previous day. I need to supply the date parameter with something
like SQL syntax: DATEADD(dd,-1,GETDATE()) . The question is how can I do that in the MDX world?
thanks
Hui
--Currently using Reporting Service 2000; Visual Studio .NET 2003; Visual Source Safe SSIS 2008 SSAS 2008, SVN --

Hi Hui,
According to your description, you need to retrieve data from previous day, so you are looking for an expression in MDX which can achieve the requirement like SQL syntax: DATEADD(dd,-1,GETDATE()), right?
As per my understanding, it easy to achieve this requirement in report level ranther than in MDX query level. You can create another hidden parameter "Date2" using the expression below.
=DateAdd("d",-1,Parameters!Date.Value)
Then use Date2 parameter to filter in the query.
If don't want to create another parameter, you can use it like below.
Year     =DatePart("yyyy",DateAdd("d",-1,Parameters!Date.Value))
Quarter =DatePart("qq",DateAdd("d",-1,Parameters!Date.Value))
Month    =DatePart("mm",DateAdd("d",-1,Parameters!Date.Value))
Week     =DatePart("ww",DateAdd("d",-1,Parameters!Date.Value))
Besides, DateAdd function is supported in MDX, please refer to the link below.
http://msdn.microsoft.com/en-us/library/hh510163.aspx
If I have anything miunderstand, please point it out.
Regards,
Charlie Liao
If you have any feedback on our support, please click
here.
Charlie Liao
TechNet Community Support

Hdparm -t yields 1.13 MB/sec

I have an Alienware 7700 Laptop, its a bit more like a desktop... with a P4 processor, etc..
I've noticed from time to time that the hard drive seemed slow, but I never thought it that much out of the ordinary (I can't say for sure if its always been this way or if this is a recent problem).
Recently I did a hdparm -t /dev/sda and got about 4.5 mb/s. I've since noticed that after a pm-suspend, this is the speed it performs at. However, if I reboot, I get:
anubis@Thorin ~/ $ sudo hdparm -t /dev/sda
/dev/sda:
Timing buffered disk reads: 84 MB in 3.04 seconds = 27.65 MB/sec
Then if I pm-suspend it goes back to 4.5 mb/s. The simple solution would seem to simply not pm-suspend, but I had a new problem last night.
anubis@Thorin ~/ $ cp amtrak1.vob /media/disk/Videos/Home_Videos/
cp: reading `amtrak1.vob': Input/output error
The drive began copying the file more and more slowly, and after this copy failed, I received this speed:
anubis@Thorin ~/ $ sudo hdparm -t /dev/sda
/dev/sda:
Timing buffered disk reads: 4 MB in 3.53 seconds = 1.13 MB/sec
My external hard drive works fine at
anubis@Thorin ~/ $ sudo hdparm -t /dev/sdb
/dev/sdb:
Timing buffered disk reads: 100 MB in 3.03 seconds = 33.00 MB/sec
I don't think it has anything to do with it, but I recently converted the internal laptop hard disk's /root and /home to ext4
sudo hdparm -I /dev/sda
/dev/sda:
ATA device, with non-removable media
Model Number: SAMSUNG MP0603H
Serial Number: S03ZJ10Y628227
Firmware Revision: UD100-14
Standards:
Used: ATA/ATAPI-7 T13 1532D revision 0
Supported: 7 6 5 4
Configuration:
Logical max current
cylinders 16383 16383
heads 16 16
sectors/track 63 63
CHS current addressable sectors: 16514064
LBA user addressable sectors: 117304992
LBA48 user addressable sectors: 117304992
Logical/Physical Sector size: 512 bytes
device size with M = 1024*1024: 57277 MBytes
device size with M = 1000*1000: 60060 MBytes (60 GB)
cache/buffer size = 8192 KBytes (type=DualPortCache)
Capabilities:
LBA, IORDY(can be disabled)
Standby timer values: spec'd by Standard, no device specific minimum
R/W multiple sector transfer: Max = 16 Current = ?
Advanced power management level: disabled
Recommended acoustic management value: 254, current value: 0
DMA: mdma0 mdma1 mdma2 udma0 udma1 *udma2 udma3 udma4 udma5
Cycle time: min=120ns recommended=120ns
PIO: pio0 pio1 pio2 pio3 pio4
Cycle time: no flow control=120ns IORDY flow control=120ns
Commands/features:
Enabled Supported:
* SMART feature set
Security Mode feature set
* Power Management feature set
* Write cache
* Look-ahead
* Host Protected Area feature set
* WRITE_BUFFER command
* READ_BUFFER command
* DOWNLOAD_MICROCODE
Advanced Power Management feature set
SET_MAX security extension
Automatic Acoustic Management feature set
* 48-bit Address feature set
* Device Configuration Overlay feature set
* Mandatory FLUSH_CACHE
* FLUSH_CACHE_EXT
* SMART error logging
* SMART self-test
* IDLE_IMMEDIATE with UNLOAD
Security:
Master password revision code = 65534
supported
not enabled
not locked
not frozen
not expired: security count
supported: enhanced erase
66min for SECURITY ERASE UNIT. 66min for ENHANCED SECURITY ERASE UNIT.
HW reset results:
CBLID- above Vih
Device num = 0 determined by the jumper
dmesg
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata5.00: port_status 0x20280000
ata5.00: cmd c8/00:00:4e:a0:c7/00:00:00:00:00/e5 tag 0 dma 131072 in
res 59/40:1b:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for UDMA/100
ata5: EH complete
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata5.00: port_status 0x20280000
ata5.00: cmd c8/00:00:4e:a0:c7/00:00:00:00:00/e5 tag 0 dma 131072 in
res 59/40:1b:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for UDMA/100
ata5: EH complete
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata5.00: port_status 0x20280000
ata5.00: cmd c8/00:00:4e:a0:c7/00:00:00:00:00/e5 tag 0 dma 131072 in
res 59/40:1b:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for UDMA/100
ata5: EH complete
ata5.00: limiting speed to UDMA/66:PIO4
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata5.00: port_status 0x20280000
ata5.00: cmd c8/00:00:4e:a0:c7/00:00:00:00:00/e5 tag 0 dma 131072 in
res 59/40:1b:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for UDMA/66
ata5: EH complete
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata5.00: port_status 0x20280000
ata5.00: cmd c8/00:00:4e:a0:c7/00:00:00:00:00/e5 tag 0 dma 131072 in
res 59/40:1b:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for UDMA/66
ata5: EH complete
ata5.00: limiting speed to UDMA/33:PIO4
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata5.00: port_status 0x20280000
ata5.00: cmd c8/00:00:4e:a0:c7/00:00:00:00:00/e5 tag 0 dma 131072 in
res 59/40:1b:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for UDMA/33
sd 4:0:0:0: [sda] Unhandled sense code
sd 4:0:0:0: [sda] Result: hostbyte=0x00 driverbyte=0x08
sd 4:0:0:0: [sda] Sense Key : 0x3 [current] [descriptor]
Descriptor sense data with sense descriptors (in hex):
72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
05 c7 a1 33
sd 4:0:0:0: [sda] ASC=0x11 ASCQ=0x4
end_request: I/O error, dev sda, sector 96969011
ata5: EH complete
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata5.00: port_status 0x20280000
ata5.00: cmd c8/00:08:2e:a1:c7/00:00:00:00:00/e5 tag 0 dma 4096 in
res 59/40:03:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for UDMA/33
ata5: EH complete
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata5.00: port_status 0x20280000
ata5.00: cmd c8/00:08:2e:a1:c7/00:00:00:00:00/e5 tag 0 dma 4096 in
res 59/40:03:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for UDMA/33
ata5: EH complete
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata5.00: port_status 0x20280000
ata5.00: cmd c8/00:08:2e:a1:c7/00:00:00:00:00/e5 tag 0 dma 4096 in
res 59/40:03:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for UDMA/33
ata5: EH complete
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata5.00: port_status 0x20280000
ata5.00: cmd c8/00:08:2e:a1:c7/00:00:00:00:00/e5 tag 0 dma 4096 in
res 59/40:03:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for UDMA/33
ata5: EH complete
ata5.00: limiting speed to PIO4
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6
ata5.00: port_status 0x20280000
ata5.00: cmd c8/00:08:2e:a1:c7/00:00:00:00:00/e5 tag 0 dma 4096 in
res 59/40:03:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for PIO4
ata5: EH complete
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
ata5.00: ST-ATA: BUSY|DRQ persists on ERR|DF, dev_stat 0x59
ata5.00: cmd 20/00:08:2e:a1:c7/00:00:00:00:00/e5 tag 0 pio 4096 in
res 59/40:03:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for PIO4
sd 4:0:0:0: [sda] Unhandled sense code
sd 4:0:0:0: [sda] Result: hostbyte=0x00 driverbyte=0x08
sd 4:0:0:0: [sda] Sense Key : 0x3 [current] [descriptor]
Descriptor sense data with sense descriptors (in hex):
72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
05 c7 a1 33
sd 4:0:0:0: [sda] ASC=0x11 ASCQ=0x4
end_request: I/O error, dev sda, sector 96969011
ata5: EH complete
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
ata5.00: ST-ATA: BUSY|DRQ persists on ERR|DF, dev_stat 0x59
ata5.00: cmd 20/00:08:2e:a1:c7/00:00:00:00:00/e5 tag 0 pio 4096 in
res 59/40:03:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for PIO4
ata5: EH complete
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
ata5.00: ST-ATA: BUSY|DRQ persists on ERR|DF, dev_stat 0x59
ata5.00: cmd 20/00:08:2e:a1:c7/00:00:00:00:00/e5 tag 0 pio 4096 in
res 59/40:03:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for PIO4
ata5: EH complete
ata5.00: limiting speed to PIO3
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
ata5.00: ST-ATA: BUSY|DRQ persists on ERR|DF, dev_stat 0x59
ata5.00: cmd 20/00:08:2e:a1:c7/00:00:00:00:00/e5 tag 0 pio 4096 in
res 59/40:03:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for PIO3
ata5: EH complete
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
ata5.00: ST-ATA: BUSY|DRQ persists on ERR|DF, dev_stat 0x59
ata5.00: cmd 20/00:08:2e:a1:c7/00:00:00:00:00/e5 tag 0 pio 4096 in
res 59/40:03:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for PIO3
ata5: EH complete
ata5.00: limiting speed to PIO0
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
ata5.00: ST-ATA: BUSY|DRQ persists on ERR|DF, dev_stat 0x59
ata5.00: cmd 20/00:08:2e:a1:c7/00:00:00:00:00/e5 tag 0 pio 4096 in
res 59/40:03:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for PIO0
ata5: EH complete
ata5.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
ata5.00: ST-ATA: BUSY|DRQ persists on ERR|DF, dev_stat 0x59
ata5.00: cmd 20/00:08:2e:a1:c7/00:00:00:00:00/e5 tag 0 pio 4096 in
res 59/40:03:33:a1:c7/00:00:00:00:00/e5 Emask 0x3 (HSM violation)
ata5.00: status: { DRDY DRQ ERR }
ata5.00: error: { UNC }
ata5: soft resetting link
ata5.00: configured for PIO0
sd 4:0:0:0: [sda] Unhandled sense code
sd 4:0:0:0: [sda] Result: hostbyte=0x00 driverbyte=0x08
sd 4:0:0:0: [sda] Sense Key : 0x3 [current] [descriptor]
Descriptor sense data with sense descriptors (in hex):
72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
05 c7 a1 33
sd 4:0:0:0: [sda] ASC=0x11 ASCQ=0x4
end_request: I/O error, dev sda, sector 96969011
ata5: EH complete
ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
ata1.00: cmd a0/00:00:00:00:00/00:00:00:00:00/a0 tag 0
cdb 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
res 51/20:03:00:00:00/00:00:00:00:00/a0 Emask 0x3 (HSM violation)
ata1.00: status: { DRDY ERR }
ata1: soft resetting link
ata1.00: configured for UDMA/33
ata1: EH complete
Could the problem be a driver/kernel issue? Or the hard drive itself? or BIOS? I'm completely mystified by extremely slow performance when I try to copy that 2.7 gb file or pm-suspend.

Hmm...
anubis@Thorin ~/ $ sudo smartctl -H /dev/sda
Password:
smartctl version 5.38 [x86_64-unknown-linux-gnu] Copyright (C) 2002-8 Bruce Allen
Home page is http://smartmontools.sourceforge.net/
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
anubis@Thorin ~/ $ sudo smartctl -l error /dev/sda
smartctl version 5.38 [x86_64-unknown-linux-gnu] Copyright (C) 2002-8 Bruce Allen
Home page is http://smartmontools.sourceforge.net/
=== START OF READ SMART DATA SECTION ===
SMART Error Log Version: 1
ATA Error Count: 60 (device log contains only the most recent five errors)
CR = Command Register [HEX]
FR = Features Register [HEX]
SC = Sector Count Register [HEX]
SN = Sector Number Register [HEX]
CL = Cylinder Low Register [HEX]
CH = Cylinder High Register [HEX]
DH = Device/Head Register [HEX]
DC = Device Command Register [HEX]
ER = Error register [HEX]
ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.
Error 60 occurred at disk power-on lifetime: 2989 hours (124 days + 13 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
40 51 08 2e a1 c7 e5 Error: UNC at LBA = 0x05c7a12e = 96969006
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
20 00 08 2e a1 c7 e5 00 03:38:10.563 READ SECTOR(S)
ec 00 00 00 00 00 a0 00 03:38:10.563 IDENTIFY DEVICE
ef 03 08 00 00 00 a0 00 03:38:10.563 SET FEATURES [Set transfer mode]
ec 00 00 00 00 00 a0 00 03:38:10.563 IDENTIFY DEVICE
00 00 01 01 00 00 a0 00 03:38:10.438 NOP [Abort queued commands]
Error 59 occurred at disk power-on lifetime: 2989 hours (124 days + 13 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
40 51 08 2e a1 c7 e5 Error: UNC at LBA = 0x05c7a12e = 96969006
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
20 00 08 2e a1 c7 e5 00 03:38:09.000 READ SECTOR(S)
ec 00 00 00 00 00 a0 00 03:38:09.000 IDENTIFY DEVICE
ef 03 0b 00 00 00 a0 00 03:38:09.000 SET FEATURES [Set transfer mode]
ec 00 00 00 00 00 a0 00 03:38:09.000 IDENTIFY DEVICE
00 00 01 01 00 00 a0 00 03:38:08.875 NOP [Abort queued commands]
Error 58 occurred at disk power-on lifetime: 2989 hours (124 days + 13 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
40 51 08 2e a1 c7 e5 Error: UNC at LBA = 0x05c7a12e = 96969006
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
20 00 08 2e a1 c7 e5 00 03:38:07.438 READ SECTOR(S)
ec 00 00 00 00 00 a0 00 03:38:07.438 IDENTIFY DEVICE
ef 03 0b 00 00 00 a0 00 03:38:07.438 SET FEATURES [Set transfer mode]
ec 00 00 00 00 00 a0 00 03:38:07.438 IDENTIFY DEVICE
00 00 01 01 00 00 a0 00 03:38:07.313 NOP [Abort queued commands]
Error 57 occurred at disk power-on lifetime: 2989 hours (124 days + 13 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
40 51 08 2e a1 c7 e5 Error: UNC at LBA = 0x05c7a12e = 96969006
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
20 00 08 2e a1 c7 e5 00 03:38:05.875 READ SECTOR(S)
ec 00 00 00 00 00 a0 00 03:38:05.813 IDENTIFY DEVICE
ef 03 0c 00 00 00 a0 00 03:38:05.813 SET FEATURES [Set transfer mode]
ec 00 00 00 00 00 a0 00 03:38:05.813 IDENTIFY DEVICE
00 00 01 01 00 00 a0 00 03:38:05.688 NOP [Abort queued commands]
Error 56 occurred at disk power-on lifetime: 2989 hours (124 days + 13 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
40 51 08 2e a1 c7 e5 Error: UNC at LBA = 0x05c7a12e = 96969006
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
20 00 08 2e a1 c7 e5 00 03:38:04.250 READ SECTOR(S)
ec 00 00 00 00 00 a0 00 03:38:04.250 IDENTIFY DEVICE
ef 03 0c 00 00 00 a0 00 03:38:04.250 SET FEATURES [Set transfer mode]
ec 00 00 00 00 00 a0 00 03:38:04.250 IDENTIFY DEVICE
00 00 01 01 00 00 a0 00 03:38:04.188 NOP [Abort queued commands]
I wonder what those errors indicate....

New WD Hard Drive ATA Link Errors

Hi there,
I just bought a new hard drive for my lenovo ThinkPad R60e. It is the following model:
# hdparm -I
ATA device, with non-removable media
Model Number: WDC WD5000BUDT-63G8FY0
Firmware Revision: 01.01A01
Transport: Serial, SATA 1.0a, SATA II Extensions, SATA Rev 2.5, SATA Rev 2.6
Standards:
Supported: 8 7 6 5
Likely used: 8
Configuration:
Logical max current
cylinders 16383 16383
heads 16 16
sectors/track 63 63
CHS current addressable sectors: 16514064
LBA user addressable sectors: 268435455
LBA48 user addressable sectors: 976773168
Logical Sector size: 512 bytes
Physical Sector size: 4096 bytes
Logical Sector-0 offset: 0 bytes
device size with M = 1024*1024: 476940 MBytes
device size with M = 1000*1000: 500107 MBytes (500 GB)
cache/buffer size = unknown
Nominal Media Rotation Rate: 5400
Capabilities:
LBA, IORDY(can be disabled)
Queue depth: 32
Standby timer values: spec'd by Standard, with device specific minimum
R/W multiple sector transfer: Max = 16 Current = 0
Advanced power management level: 128
Recommended acoustic management value: 128, current value: 254
DMA: mdma0 mdma1 mdma2 udma0 udma1 udma2 udma3 udma4 *udma5 udma6
Cycle time: min=120ns recommended=120ns
PIO: pio0 pio1 pio2 pio3 pio4
Cycle time: no flow control=120ns IORDY flow control=120ns
Commands/features:
Enabled Supported:
* SMART feature set
Security Mode feature set
* Power Management feature set
* Write cache
* Look-ahead
* Host Protected Area feature set
* WRITE_BUFFER command
* READ_BUFFER command
* NOP cmd
* DOWNLOAD_MICROCODE
* Advanced Power Management feature set
Power-Up In Standby feature set
* SET_FEATURES required to spinup after power up
SET_MAX security extension
* Automatic Acoustic Management feature set
* 48-bit Address feature set
* Device Configuration Overlay feature set
* Mandatory FLUSH_CACHE
* FLUSH_CACHE_EXT
* SMART error logging
* SMART self-test
Media Card Pass-Through
* General Purpose Logging feature set
* 64-bit World wide name
* URG for READ_STREAM[_DMA]_EXT
* URG for WRITE_STREAM[_DMA]_EXT
* IDLE_IMMEDIATE with UNLOAD
* {READ,WRITE}_DMA_EXT_GPL commands
* Segmented DOWNLOAD_MICROCODE
* Gen1 signaling speed (1.5Gb/s)
* Gen2 signaling speed (3.0Gb/s)
* Native Command Queueing (NCQ)
* Host-initiated interface power management
* Phy event counters
* Idle-Unload when NCQ is active
* NCQ priority information
DMA Setup Auto-Activate optimization
Device-initiated interface power management
* Software settings preservation
* SMART Command Transport (SCT) feature set
* SCT Features Control (AC4)
* SCT Data Tables (AC5)
unknown 206[12] (vendor specific)
unknown 206[13] (vendor specific)
unknown 206[14] (vendor specific)
Security:
Master password revision code = 65534
supported
not enabled
not locked
not frozen
not expired: security count
supported: enhanced erase
138min for SECURITY ERASE UNIT. 138min for ENHANCED SECURITY ERASE UNIT.
Logical Unit WWN Device Identifier: 50014ee60132e99d
NAA : 5
IEEE OUI : 0014ee
Unique ID : 60132e99d
Checksum: correct
As it uses Advanced Format, I did an aligned partitioning as you can see here:
# fdisk -u -l
Disk /dev/sda: 500.1 GB, 500107862016 bytes
255 heads, 63 sectors/track, 60801 cylinders, total 976773168 sectors
Units = sectors of 1 * 512 = 512 bytes
Disk identifier: 0x04801fe0
Device Boot Start End Blocks Id System
/dev/sda1 2048 224909 111431 83 Linux
/dev/sda2 224912 44275139 22025114 83 Linux
/dev/sda3 44275144 48484169 2104513 83 Linux
/dev/sda4 48484176 976768064 464141944+ 83 Linux
After that I tried to copy my old system and data from the old hard drive (The new WD drive was built into the laptop and the old drive connected via SATA2USB adaptor). After a few minutes the hdd started to hang and the following messages occured in "dmesg"
[ 934.624568] ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x0
[ 934.624575] ata1.00: BMDMA stat 0x25
[ 934.624583] ata1.00: failed command: WRITE DMA EXT
[ 934.624596] ata1.00: cmd 35/00:80:68:2b:13/00:01:2d:00:00/e0 tag 0 dma 196608 out
[ 934.624599] res 61/04:10:f0:1c:13/04:00:2d:00:00/e0 Emask 0x1 (device error)
[ 934.624606] ata1.00: status: { DRDY DF ERR }
[ 934.624611] ata1.00: error: { ABRT }
[ 934.631465] ata1.00: failed to read native max address (err_mask=0x1)
[ 934.631472] ata1.00: HPA support seems broken, skipping HPA handling
[ 934.646871] ata1.00: configured for UDMA/133 (device error ignored)
[ 934.646890] ata1: EH complete
[ 1234.019934] ata1: link is slow to respond, please be patient (ready=0)
[ 1239.033266] ata1: device not ready (errno=-16), forcing hardreset
[ 1239.033279] ata1: soft resetting link
[ 1244.199930] ata1: link is slow to respond, please be patient (ready=0)
[ 1249.053269] ata1: SRST failed (errno=-16)
[ 1249.053282] ata1: soft resetting link
[ 1254.219921] ata1: link is slow to respond, please be patient (ready=0)
[ 1259.073267] ata1: SRST failed (errno=-16)
[ 1259.073279] ata1: soft resetting link
[ 1264.239938] ata1: link is slow to respond, please be patient (ready=0)
First I thought it looks like a problem with the SATA connector within my notebook, but it shouldn't be case as the hdd sits tight and the old one still works. Moreover I tried to change SATA settings in BIOS from "AHCI" to "Compatibility" in case of a driver fault, but this also didn't fix the issue.
For now I have connected the new hard drive with the SATA2USB adaptor and do some writing on it via dd. In this case, the errors do not occur at all.
The disk now gives me errors even if connected via USB. So I assume it is a hardware defect. The Western Digital Drive Check tools won't boot, but, I think these errors are more or less unambiguous
[ 268.018935] Buffer I/O error on device sdb, logical block 77649
[ 268.018938] lost page write due to I/O error on sdb
[ 268.226335] sd 2:0:0:0: [sdb] Unhandled sense code
[ 268.226340] sd 2:0:0:0: [sdb] Result: hostbyte=0x00 driverbyte=0x08
[ 268.226345] sd 2:0:0:0: [sdb] Sense Key : 0x3 [current]
[ 268.226350] sd 2:0:0:0: [sdb] ASC=0xc ASCQ=0x0
[ 268.226355] sd 2:0:0:0: [sdb] CDB: cdb[0]=0x2a: 2a 00 00 09 7b 30 00 00 f0 00
[ 268.226366] end_request: I/O error, dev sdb, sector 621360
[ 268.434722] sd 2:0:0:0: [sdb] Unhandled sense code
[ 268.434732] sd 2:0:0:0: [sdb] Result: hostbyte=0x00 driverbyte=0x08
[ 268.434740] sd 2:0:0:0: [sdb] Sense Key : 0x3 [current]
[ 268.434748] sd 2:0:0:0: [sdb] ASC=0xc ASCQ=0x0
[ 268.434756] sd 2:0:0:0: [sdb] CDB: cdb[0]=0x2a: 2a 00 00 09 7c 20 00 00 f0 00
[ 268.434775] end_request: I/O error, dev sdb, sector 621600
[ 268.642711] sd 2:0:0:0: [sdb] Unhandled sense code
[ 268.642718] sd 2:0:0:0: [sdb] Result: hostbyte=0x00 driverbyte=0x08
[ 268.642723] sd 2:0:0:0: [sdb] Sense Key : 0x3 [current]
[ 268.642728] sd 2:0:0:0: [sdb] ASC=0xc ASCQ=0x0
[ 268.642733] sd 2:0:0:0: [sdb] CDB: cdb[0]=0x2a: 2a 00 00 09 7d 10 00 00 f0 00
[ 268.642744] end_request: I/O error, dev sdb, sector 621840
[ 268.849950] sd 2:0:0:0: [sdb] Unhandled sense code
[ 268.849956] sd 2:0:0:0: [sdb] Result: hostbyte=0x00 driverbyte=0x08
[ 268.849961] sd 2:0:0:0: [sdb] Sense Key : 0x3 [current]
[ 268.849967] sd 2:0:0:0: [sdb] ASC=0xc ASCQ=0x0
[ 268.849971] sd 2:0:0:0: [sdb] CDB: cdb[0]=0x2a: 2a 00 00 09 7e 00 00 00 f0 00
[ 268.850004] end_request: I/O error, dev sdb, sector 622080
[ 269.057592] sd 2:0:0:0: [sdb] Unhandled sense code
[ 269.057598] sd 2:0:0:0: [sdb] Result: hostbyte=0x00 driverbyte=0x08
[ 269.057603] sd 2:0:0:0: [sdb] Sense Key : 0x3 [current]
[ 269.057608] sd 2:0:0:0: [sdb] ASC=0xc ASCQ=0x0
[ 269.057612] sd 2:0:0:0: [sdb] CDB: cdb[0]=0x2a: 2a 00 00 09 7e f0 00 00 f0 00
[ 269.057624] end_request: I/O error, dev sdb, sector 622320
[ 299.466711] usb 1-1: reset high speed USB device number 3 using ehci_hcd
[ 329.760049] usb 1-1: reset high speed USB device number 3 using ehci_hcd
[ 354.454537] usb 1-1: USB disconnect, device number 3
[ 354.458395] sd 2:0:0:0: [sdb] Unhandled error code
[ 354.458404] sd 2:0:0:0: [sdb] Result: hostbyte=0x01 driverbyte=0x00
[ 354.458412] sd 2:0:0:0: [sdb] CDB: cdb[0]=0x2a: 2a 00 00 09 7f e0 00 00 f0 00
[ 354.458431] end_request: I/O error, dev sdb, sector 622560
[ 354.458446] quiet_error: 170 callbacks suppressed
[ 354.458451] Buffer I/O error on device sdb, logical block 77820
For the sake of completeness, here are the SMART values:
smartctl 5.40 2010-02-03 r3060 [i686-pc-linux-gnu] (local build)
Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net
=== START OF INFORMATION SECTION ===
Device Model: WDC WD5000BUDT-63G8FY0
Firmware Version: 01.01A01
User Capacity: 500,107,862,016 bytes
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: 8
ATA Standard is: Exact ATA specification draft version not indicated
Local Time is: Sun Jul 10 09:44:26 2011 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (13560) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 158) minutes.
Conveyance self-test routine
recommended polling time: ( 5) minutes.
SCT capabilities: (0x7031) SCT Status supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 0
3 Spin_Up_Time 0x0027 189 185 021 Pre-fail Always - 1541
4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 54
5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0
7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0
9 Power_On_Hours 0x0032 100 100 000 Old_age Always - 16
10 Spin_Retry_Count 0x0032 100 253 000 Old_age Always - 0
11 Calibration_Retry_Count 0x0032 100 253 000 Old_age Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 50
192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 36
193 Load_Cycle_Count 0x0032 200 200 000 Old_age Always - 164
194 Temperature_Celsius 0x0022 111 105 000 Old_age Always - 36
196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0
197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0030 100 253 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0
200 Multi_Zone_Error_Rate 0x0008 100 253 000 Old_age Offline - 0
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
It is regardless which kernel version I use (latest ARCH 2.6.39 or 2.6.23 from a grml live system), the error is persistent everywhere.
I will just send it back for warranty. In fact, it's another prove for today's harddisk "quality"
EDITED: 1. forgot some detail in dmesg; 2. Finally got it
Last edited by fixje (2011-07-10 11:35:06)

We call it case or drive hum. And it seems like a harmonic clash of two devices, or the 2nd hard drive causing the case itself (metal case).
There are shock absorbent washers on the side metal door.
Drive is attached and firmly installed and the latch on the back is securely in down and lock position.
And of course it still happens.
Me, I'd pull the old inefficient 250GB drive with 8MB cache, the Seagate 7200.9s that some shipped with were horrible performance and noise).
What I do with drive is run it through WD Lifeguard in Windows a couple times (Extended Test, full format instead of quick).
Some people sought out drive sled anti-vibration washers to fit to the sled (can't change the height though in order to fit properly).
Turn off "allow drives to spin down when not in use" if on.

Command line option to specify Bridge master cache

Please allow a bridge command line option to allow the user to select a specific bridge master cache.
The motivation is as follows: I have written a c++ programme to key-word all of my many thousands of photo projects. Essentially each project is in a separate directory on 8 terabytes of networked disk. Associated with each directory is a set of key words. When the appropriate project is selected, I invoke Bridge to open that directory, possibly with a specific images as the "starting image" for that project. Since the master cache files are split (to accomodate the 500,000 max image count supported by bridge), it would be excellent if I can pass a reference to the specific master cache associated with that directory.
A second value of this option would allow the user to create desk-top short-cuts to invoke bridge using an appropriate cache structure. For example, the properties of one short cut could specify the cache file for the current daily use of the Bridge to process images in progress. A second could point the the cache associated with the historical first 400,000 image archived on the network, and a third could invoke bridge pointing to the cache for the next 400,000 image cache - or whatever grouping the user needs to match his workflow when using Bridge as the central focus for various digital assets..
This type of processing allows the user to conveniently invoke bridge according the the needed work flow when multiple cache systems are required. In addition, the multiple desk-top shortcuts would minimize the "error" of having bridge pointed, by accident/neglect, to the incorrect cache structure.
It would also be valuable to allow the user to display the current number of actual image items in a cache system - either as a "view" or "tools" option. This would allow the user to know when it is time to start a new master cache system. Of course, this can be intependently viewed in windows explorer by the count of files in the 1024 or 256 directories - however maybe the cache structure already "knows" this number instantly. Other statistics could be interesting as well - possibly the number of directories known to the cache (possibly the same as the count of directories within the 1024 or 256 directories). Possibly the number of files cached by file type (jpg, tif, psd, cr2, nef, etc) would be of interest to some folks - however, such things should be user-selectable since such analysis might be time intensive and maybe of no interest.
Of course, I do not know if this is consistent with other uses of Bridge - this request is made based upon my use of Bridge as a still photographer and a few videos I have created.
thank you....
tony

I'm going to be technical for a minute, just for the Forum archives...
The Library file location is stored in your "iTunes Prefs.xml" file in<pre>%APPDATA%Apple ComputeriTunes</pre>.
Actually, I should say that if you are using a non-default location, there is a key for "iTunes Library Location:1", e.g.:
<key>iTunes Library Location:1</key>
<data>
QwA6AFwARABvAGMAdQBtAGUAbgB0AHMAIABhAG4AZAAgAFMAZQB0AHQAaQBu
AGcAcwBcAFQAZQByAGkAZABvAG4AXABNAHkAIABEAG8AYwB1AG0AZQBuAHQA
cwBcAE0AeQAgAE0AdQBzAGkAYwBcAHQAZQBzAHQAbABpAGIAcgBhAHIAeQA=
</data>
The "data" is a base64-encoded UTF16-LE string that is the folder containing the "iTunes Library.itl" file and "Album Artwork" folder. In the above case:<pre>C:Documents and SettingsTeridonMy DocumentsMy Music estlibrary</pre>
The key/data pair does not exist if you're using the default Library location.
Similary, there is a key/value pair for "iTunes Library XML Location:1" -- except this part always appears, even if you are using the default location. Also, it is the full path to the file itself, not just the directory containing it. e.g.:<pre>C:Documents and SettingsTeridonMy DocumentsMy Music estlibraryiTunes Library.xml</pre>
Since it doesn't appear that double-clicking on the Library file you want to open works, I'm guessing the only way to swap locations is to edit the preferences file -- either directly, or with a script/program. I could probably write such a program in a 1/2 hour or so... I might just do that right now.

Old computer - slow transfers for sata

hi all,
I've set up a linux box with very old stuff. I'm talking about a Pentium II 350 MHz on a Asus P5B, 192 MB RAM. Though I have some new disks, with which I am experienceing slow transfers and I would like to know some advices on what could I do. Or maybe to know that the answer is: the cpu power is too low to have decent speeds.
Now, briefly what I've is:
- on a PCI, an old Promise FastTrak TX4 sata 150
- on it, 3 WD20EARS 2TB disks
- consider 2 of them. They have been partitioned with parted
- the partition method has been (for both): gpt label, mkpart with starting sector 2048s and end -1. This should have been guaranteed alignment for the 4K sectors of the drive
- filesystem is lvm for both. each is a single big pv on single vg on a single lv (consider one is the drive where I store all my photos - 2TB big, the other is the drive where I store backups of them - 2TB)
when I transfer files between them (tens of folders of hundreds of files size 600kb-4mb) for backup with rsnapshot I see the following, using iostat 5 -m:
avg-cpu: %user %nice %system %iowait %steal %idle
37.33 0.80 60.88 1.00 0.00 0.00
Device: tps MB_read/s MB_wrtn/s MB_read MB_wrtn
sda 0.00 0.00 0.00 0 0
sdb 83.03 5.69 0.01 28 0
sdc 19.96 0.00 5.63 0 28
scd0 0.00 0.00 0.00 0 0
sdd 14.57 0.19 0.02 0 0
dm-0 1440.52 0.00 5.63 0 28
dm-1 0.00 0.00 0.00 0 0
dm-2 1449.10 5.66 0.00 28 0
dm-3 1449.10 5.66 0.00 28 0
dm-4 2.00 0.00 0.01 0 0
now the question: is there a way to get better speeds and to lower cpu load?
please note that, according to hdparm, everything should be correct (just an output from hdparm -I is shown here, they are exactly the same):
ATA device, with non-removable media
Model Number: WDC WD20EARS-00MVWB0
Serial Number: WD-WCAZA2284951
Firmware Revision: 51.0AB51
Transport: Serial, SATA 1.0a, SATA II Extensions, SATA Rev 2.5, SATA Rev 2.6
Standards:
Supported: 8 7 6 5
Likely used: 8
Configuration:
Logical max current
cylinders 16383 16383
heads 16 16
sectors/track 63 63
CHS current addressable sectors: 16514064
LBA user addressable sectors: 268435455
LBA48 user addressable sectors: 3907029168
Logical/Physical Sector size: 512 bytes
device size with M = 1024*1024: 1907729 MBytes
device size with M = 1000*1000: 2000398 MBytes (2000 GB)
cache/buffer size = unknown
Capabilities:
LBA, IORDY(can be disabled)
Queue depth: 32
Standby timer values: spec'd by Standard, with device specific minimum
R/W multiple sector transfer: Max = 16 Current = 0
Recommended acoustic management value: 128, current value: 254
DMA: mdma0 mdma1 mdma2 udma0 udma1 udma2 udma3 udma4 udma5 *udma6
Cycle time: min=120ns recommended=120ns
PIO: pio0 pio1 pio2 pio3 pio4
Cycle time: no flow control=120ns IORDY flow control=120ns
Commands/features:
Enabled Supported:
* SMART feature set
Security Mode feature set
* Power Management feature set
* Write cache
* Look-ahead
* Host Protected Area feature set
* WRITE_BUFFER command
* READ_BUFFER command
* NOP cmd
* DOWNLOAD_MICROCODE
Power-Up In Standby feature set
* SET_FEATURES required to spinup after power up
SET_MAX security extension
Automatic Acoustic Management feature set
* 48-bit Address feature set
* Device Configuration Overlay feature set
* Mandatory FLUSH_CACHE
* FLUSH_CACHE_EXT
* SMART error logging
* SMART self-test
* General Purpose Logging feature set
* 64-bit World wide name
* WRITE_UNCORRECTABLE_EXT command
* {READ,WRITE}_DMA_EXT_GPL commands
* Segmented DOWNLOAD_MICROCODE
* Gen1 signaling speed (1.5Gb/s)
* Gen2 signaling speed (3.0Gb/s)
* Native Command Queueing (NCQ)
* Host-initiated interface power management
* Phy event counters
* NCQ priority information
DMA Setup Auto-Activate optimization
* Software settings preservation
* SMART Command Transport (SCT) feature set
* SCT LBA Segment Access (AC2)
* SCT Features Control (AC4)
* SCT Data Tables (AC5)
unknown 206[12] (vendor specific)
unknown 206[13] (vendor specific)
Security:
Master password revision code = 65534
supported
not enabled
not locked
not frozen
not expired: security count
supported: enhanced erase
402min for SECURITY ERASE UNIT. 402min for ENHANCED SECURITY ERASE UNIT.
Logical Unit WWN Device Identifier: 50014ee205346fd3
NAA : 5
IEEE OUI : 0014ee
Unique ID : 205346fd3
uname -a is:
Linux myhost 2.6.36-ARCH #1 SMP PREEMPT Sat Jan 8 13:16:43 UTC 2011 i686 Pentium II (Deschutes) GenuineIntel GNU/Linux
any help?
thanks a lot
Gemon

I will try adding some ram, I should have 128mb on my wife's brother pc.
Just some quick tests with dd to see if it is a problem of the pci channel - apparently it looks like. Tomorrow I will try to move one of the two disks on the other sata controller I have on the other pci slot.
First test is writing a sequential file to a WD20EARS (/dev/sdbx or /photo/photo as lvm)
Second test is reading from that same disk. 75 mb/s looks like a nice speed, considering the hosting pc anc pci slot bound at 133 mb/s bw
Third test is copying from one WD20EARS to the other
Fourth test is copying from one WD20EARS to the PATA drive where I have linux installed - consider this is on the motherboard controller and can do udma/33 only.
[root@myhost gemon]# dd if=/dev/zero of=/photo/photo/output.img bs=8k count=256k
262144+0 records in
262144+0 records out
2147483648 bytes (2.1 GB) copied, 146.265 s, 14.7 MB/s
[root@myhost gemon]# dd if=/photo/photo/output.img of=/dev/null bs=8k count=256k
262144+0 records in
262144+0 records out
2147483648 bytes (2.1 GB) copied, 28.3661 s, 75.7 MB/s
[root@myhost gemon]# dd if=/photo/photo/output.img of=/backup-photo/output.img bs=8k count=256k
262144+0 records in
262144+0 records out
2147483648 bytes (2.1 GB) copied, 93.4719 s, 23.0 MB/s
[root@myhost gemon]# dd if=/photo/photo/output.img of=/home/gemon/output.img bs=8k count=256k
262144+0 records in
262144+0 records out
2147483648 bytes (2.1 GB) copied, 116.291 s, 18.5 MB/s
tomorrow I'll redo some tests with the secondo wd20ears on the other pci slot.
thanks everybody for the first answers
Gemon
PS: filesystem is ext4 on all those lvm logical volumes

Slow hdd performance

Ok I did some research and still can't figure out why writing/reading speed is so slow in practice
hdparm -tT /dev/sda
/dev/sda:
Timing cached reads: 1012 MB in 2.00 seconds = 506.11 MB/sec
Timing buffered disk reads: 336 MB in 3.01 seconds = 111.58 MB/sec
With dd I get ~10 MB/s (dd if=/dev/zero of=/test bs=100M count=10)
Internally copy from mc 5-6 MB/s
I did multiple tests
What is going on here?
hdparm -I /dev/sda
/dev/sda:
ATA device, with non-removable media
Model Number: ST31000520AS
Serial Number: 5VX0WRYD
Firmware Revision: CC32
Transport: Serial
Standards:
Used: unknown (minor revision code 0x0029)
Supported: 8 7 6 5
Likely used: 8
Configuration:
Logical max current
cylinders 16383 16383
heads 16 16
sectors/track 63 63
CHS current addressable sectors: 16514064
LBA user addressable sectors: 268435455
LBA48 user addressable sectors: 1953525168
Logical/Physical Sector size: 512 bytes
device size with M = 1024*1024: 953869 MBytes
device size with M = 1000*1000: 1000204 MBytes (1000 GB)
cache/buffer size = unknown
Nominal Media Rotation Rate: 5900
Capabilities:
LBA, IORDY(can be disabled)
Queue depth: 32
Standby timer values: spec'd by Standard, no device specific minimum
R/W multiple sector transfer: Max = 16 Current = 16
Advanced power management level: 192
Recommended acoustic management value: 254, current value: 254
DMA: mdma0 mdma1 mdma2 udma0 udma1 udma2 udma3 udma4 udma5 *udma6
Cycle time: min=120ns recommended=120ns
PIO: pio0 pio1 pio2 pio3 pio4
Cycle time: no flow control=120ns IORDY flow control=120ns
Commands/features:
Enabled Supported:
* SMART feature set
Security Mode feature set
* Power Management feature set
* Write cache
* Look-ahead
* Host Protected Area feature set
* WRITE_BUFFER command
* READ_BUFFER command
* DOWNLOAD_MICROCODE
* Advanced Power Management feature set
Power-Up In Standby feature set
SET_FEATURES required to spinup after power up
SET_MAX security extension
* Automatic Acoustic Management feature set
* 48-bit Address feature set
* Device Configuration Overlay feature set
* Mandatory FLUSH_CACHE
* FLUSH_CACHE_EXT
* SMART error logging
* SMART self-test
* General Purpose Logging feature set
* WRITE_{DMA|MULTIPLE}_FUA_EXT
* 64-bit World wide name
Write-Read-Verify feature set
* WRITE_UNCORRECTABLE_EXT command
* {READ,WRITE}_DMA_EXT_GPL commands
* Segmented DOWNLOAD_MICROCODE
* Gen1 signaling speed (1.5Gb/s)
* Native Command Queueing (NCQ)
* Phy event counters
Device-initiated interface power management
* Software settings preservation
* SMART Command Transport (SCT) feature set
* SCT Long Sector Access (AC1)
* SCT LBA Segment Access (AC2)
* SCT Error Recovery Control (AC3)
* SCT Features Control (AC4)
* SCT Data Tables (AC5)
unknown 206[12] (vendor specific)
Security:
Master password revision code = 65534
supported
not enabled
not locked
frozen
not expired: security count
supported: enhanced erase
188min for SECURITY ERASE UNIT. 188min for ENHANCED SECURITY ERASE UNIT.
Logical Unit WWN Device Identifier: 5000c500250e4711
NAA : 5
IEEE OUI : 000c50
Unique ID : 0250e4711
Checksum: correct
smartctl -a /dev/sda
smartctl 5.42 2011-10-20 r3458 [i686-linux-3.2.13-1-ARCH] (local build)
Copyright (C) 2002-11 by Bruce Allen, [url]http://smartmontools.sourceforge.net[/url]
=== START OF INFORMATION SECTION ===
Model Family: Seagate Barracuda LP
Device Model: ST31000520AS
Serial Number: 5VX0WRYD
LU WWN Device Id: 5 000c50 0250e4711
Firmware Version: CC32
User Capacity: 1,000,204,886,016 bytes [1,00 TB]
Sector Size: 512 bytes logical/physical
Device is: In smartctl database [for details use: -P show]
ATA Version is: 8
ATA Standard is: ATA-8-ACS revision 4
Local Time is: Fri Mar 30 00:45:54 2012 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 623) seconds.
Offline data collection
capabilities: (0x73) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
No Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 219) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x103f) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 119 099 006 Pre-fail Always - 216824470
3 Spin_Up_Time 0x0003 096 096 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 526
5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 3
7 Seek_Error_Rate 0x000f 077 060 030 Pre-fail Always - 58496816
9 Power_On_Hours 0x0032 084 084 000 Old_age Always - 14481
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 037 020 Old_age Always - 265
183 Runtime_Bad_Block 0x0032 100 100 000 Old_age Always - 0
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 098 000 Old_age Always - 8590065682
189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0022 070 054 045 Old_age Always - 30 (Min/Max 18/31)
194 Temperature_Celsius 0x0022 030 046 000 Old_age Always - 30 (0 16 0 0 0)
195 Hardware_ECC_Recovered 0x001a 039 021 000 Old_age Always - 216824470
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 199 000 Old_age Always - 9
240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 152454159153810
241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 3670022033
242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 448914133
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Short offline Completed without error 00% 14007 -
# 2 Extended offline Interrupted (host reset) 00% 13651 -
# 3 Extended offline Aborted by host 90% 8256 -
# 4 Short offline Completed without error 00% 310 -
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
cat /etc/fstab
# <file system> <dir> <type> <options> <dump> <pass>
devpts /dev/pts devpts defaults 0 0
shm /dev/shm tmpfs defaults 0 0
/dev/sr0 /mnt/cd iso9660 ro,user,noauto,unhide 0 0
#/dev/dvd /media/dvd auto ro,user,noauto,unhide 0 0
#/dev/fd0 /media/fl auto user,noauto 0 0
UUID=934647db-14d1-4641-820c-e42c0f63c0e5 /boot ext2 defaults 0 2
/dev/mapper/lvm-home /home ext4 defaults,noatime 0 2
/dev/mapper/lvm-root / ext4 defaults,noatime 0 1
/dev/mapper/lvm-swap swap swap defaults 0 0
tmpfs /tmp tmpfs noatime,nodev,nosuid,noexec,size=1536M 0 0
/dev/mapper/data /mnt/data ext4 acl,user_xattr,noatime 0 2
dmesg | grep ata
[ 0.000000] BIOS-e820: 000000001f5d7000 - 000000001f5d9000 (ACPI data)
[ 0.000000] BIOS-e820: 000000001f600000 - 000000001f608000 (ACPI data)
[ 0.000000] Memory: 481496k/515072k available (3766k kernel code, 31608k reserved, 1441k data, 524k init, 0k highmem)
[ 0.000000] .data : 0xc04ad9d5 - 0xc06160c0 (1441 kB)
[ 14.174799] Write protecting the kernel read-only data: 1112k
[ 14.661110] libata version 3.00 loaded.
[ 14.684788] ata1: SATA max UDMA/133 abar m1024@0xffe40000 port 0xffe40100 irq 45
[ 14.684809] ata2: DUMMY
[ 14.684826] ata3: SATA max UDMA/133 abar m1024@0xffe40000 port 0xffe40200 irq 45
[ 14.684842] ata4: DUMMY
[ 14.685022] ata_piix 0000:00:1f.1: version 2.13
[ 14.685081] ata_piix 0000:00:1f.1: PCI INT A -> GSI 18 (level, low) -> IRQ 18
[ 14.685243] ata_piix 0000:00:1f.1: setting latency timer to 64
[ 14.699846] scsi4 : ata_piix
[ 14.705173] scsi5 : ata_piix
[ 14.715618] ata5: PATA max UDMA/100 cmd 0x1f0 ctl 0x3f6 bmdma 0xf100 irq 14
[ 14.715642] ata6: PATA max UDMA/100 cmd 0x170 ctl 0x376 bmdma 0xf108 irq 15
[ 15.006827] ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[ 15.008016] ata1.00: ATA-8: ST31000520AS, CC32, max UDMA/133
[ 15.008034] ata1.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 31/32)
[ 15.009380] ata1.00: configured for UDMA/133
[ 15.013441] ata3: SATA link down (SStatus 0 SControl 300)
[ 40.720777] EXT4-fs (dm-1): mounted filesystem with ordered data mode. Opts: (null)
[ 59.246412] EXT4-fs (dm-3): mounted filesystem with ordered data mode. Opts: (null)
[ 59.339759] EXT4-fs (dm-4): mounted filesystem with ordered data mode. Opts: acl,user_xattr
EDIT: Replaced quote with code - ngoonee
EDIT: Ok, sorry - miskoala
Last edited by miskoala (2012-03-30 08:18:09)

I booted this drive from another computer (Asrock M3A770DE mobo) and works fine, speed with dd was ~100MB/s
I also update bios on my first computer with Intel D945GSEJT (there is selected AHCI mode) still the same transfers with dd (~10Mb/s)
I have no idea what to do with it now
EDIT:
More tests with other hdd (Samsung HD502IJ), dd on mounted NTFS partition:
Intel D945GSEJT booted from Archlinux iso:
hdparm: ~75 MB/s
dd: ~10 MB/s
Intel D945GSEJT booted from Archlinux iso, HDD connected to PCI SATA controller (Promise 378):
hdparm: ~60 MB/s
dd: ~10 MB/s
Asrock M3A770DE booted from Archlinux iso:
hdparm: ~87 MB/s
dd: ~76 MB/s
Asrock M3A770DE booted from Archlinux iso, HDD connected to PCI SATA controller (Promise 378):
hdparm: ~81MB/s
dd: ~76 MB/s
What is broken on D945GSEJT?
Last edited by miskoala (2012-03-30 13:47:23)

Disctinct count supported in MDX?

Similar Messages

Maybe you are looking for