Is data compression all automatic? Or does manual steps occur in HANA Studio

Hi all,
I'm new to HANA and have been leveraging SCN in a BIG way to answer my questions (thanks everyone for your contributions). This is my first post as I was unable to find an answer to my current question .
I've been reading up on data compression in HANA and I learned that there are different techniques, such as Dictionary, Cluster, and Run-length encoding.
My Question is: Is the compression automatic? Or does it need to be modeled within HANA Studio? Let's use Dictionary Encoding as an example. Are there algorithms in place within HANA that will automatically aggregate values so only distinct values remain? Will the attribute vector and inverted indexed tables automatically be created?
Just as some background, this is what I am basing my question on:
http://www.agilityworks.co.uk/our-blog/demystifying-the-column-store-%E2%80%93-viewing-column-store-statistics-in-sap-ha…
Thank you!
Kyle

Hi Justin,
you are right, the compression is related to the delta merge - and therefore, as long as delta merges happen automatically, compression will also happen automatically.
SAP HANA has two compression stages on the column store: the first - and typically dominating one - is the implicit compression obtained from using a data dictionary for all column-store columns.
The second stage is often called "sparse compression" - it offers additional compression on top of the dictionary compression, with several available algorithms. During the "optimize compression" run, the most appropriate compression algorithm is chosen for each column (and some columns may not be sparse-compressed at all, because it would not bring a benefit).
The optimize compression run does not happen with every delta merge. Instead, it will be performed with the first delta merge on a given table, and then only if the data content of the table has changed significantly (typically, if I remember correctly, the system waits until the number of records has doubled. Note that the optimize compression run may _change_ the compression type chosen for a given column. The sparse compression itself will be done with every delta merge, using the algorithms selected in the past optimze compression.
If you have switched off automatic delta merging globally, or if you have disabled automatic delta merging for a given table, there will also be no automatic compression (in the entire system or on the given table). BW on HANA uses the smart merge feature, so that in a standard BW on HANA, automatic compression will happen (with the timing of the delta merge being decided in a cooperation between BW and HANA).
Best,
Richard

Similar Messages

Reference Field to populate automatically when doing manually clearing F-30

Hi,
I have a requirement from my client where we have to get the reference field XBLNR to the clearing document from the document it actually clears when doing the manually clearing through F-30.
Is there any standard SAP note for this.
Can you please suggest any other way. It should be automatic.
Thanks,
Srini

Hi,
Sorry you both are thinking in the wrong direction, let me explain by giving an example...
Open Item         Document Number         Reference Number
£2500                  3500000253                   ABC125663
Cleared Item
£2500                   6500000562                  ABC125663
My requirement is I want to auto populate the reference number of the cleared item with that of open item.
That means "ABC125663". I hope I have explained the requirement clearly.
If you have any answers please let me know.
Thanks,
Srini

Why does "itunes accounts" use data with all settings OFF?

Does anyone know how to keep "iTunes accounts" under system from using cellular data?
I have already:
1. Toggled OFF all settings in the "Use cellular data for" menu.
2. Turned OFF all automatic downloads and any other options under iTunes/app store settings.
3. Turned OFF Background App refresh.
4. Turned OFF all options under iCloud sync menu.
Right now, the only thing that keeps "iTunes accounts" from pulling cellular data is turning Cellular Data completely OFF, but I don't want to do this because I lose some messaging and voicemail functions and I need to be able to use Find My Phone. I have two identical iPhone 5c's on this account. One is running iOs 8.1.2 and the above settings control it's data usage nicely. The other phone is running iOs 8.1.3 and this one uses 50-100 mb a day even with all the above settings off and the phone almost always on wifi.
I am aware that the phone will lose it's wifi connection when asleep, but that shouldn't be a problem if all the apps/settings are already set not to use cellular data. What am I missing. I've read a bunch of threads on this issue and they all suggest settings I already have OFF.

My personal phone is on 8.1.2. My daughter's phone is 8.1.3.
It is her phone that is currently having this problem, but I reported it under my account; sorry for the confusion.
My phone has had some data problems in the past, but I have been able to control them by keeping almost all data options OFF and the overall switch ON. My usage is back to less than 50 mb per month which makes sense since my phone is almost always on wifi and I don't use data dense applications.
Everything about my daughter's phone is the same as mine except for the 8.1.3 upgrade. She does use things like Instagram more than I do, but I have them all set to not use Cellular Data and the option to change these settings is locked. When I look at the usage on her phone, it isn't her apps that are pulling unexpected data; it's "iTunes accounts" under system services. All the options under iTunes/App Store (auto downloads, home sharing, etc.) and all the iCloud options are already OFF.

Apple TV just ate a gig of cell data thru iPad hotspot and all I was doing was playing iTunes off Mac

1 Gig on a 4 gig cell plan gone forever and it's only 8 days into billing month. iPad has wifi and personal hotspot on. Mac mini and ATV both connected. All I'm doing is playing iTunes and running photos from Mac to TV. No movies, no surfing on ATV. 2 hours later I happened to check the iPad and all this cell data is used up. Oh yeah, I also had an old iPhone connected to use as ATV remote. It all works great but I really need to know what, why and where the cell data went.
Yes I live in an area where my only choice for internet in thru cell towers. Thus a 3 gig plan on iPhone and a 4 gig plan on iPad. Expensive yes, but I have little choice and now I am stuck till a new billing period starts. Thankfully none of the devices downloaded 8.0.2 or I'd really be screwed. For that I have to go begging for someone's cable connection or try a public wifi if I have 4 hours to kill.
Side gripe. Since you can no longer get OS upgrades on CD, the Mac never did get Maverick upgrade. Setting up a wifi connection to download 4-5 gigs to Mac ain't gonna happen. I tell ya, us off the wired grid people get no respect.

Another day, another failure. ATV will not connect to iPad wifi unless Personal Hotspot is turned on which you can't turn on without Cellular Data being turned on. So, at this point I have a $99 brick. Oh wait, it cached my photos and displays those just fine. Thanks so much Apple for thinking of us stuck in "3rd world country" outside a major US city. ATT does not offer U-verse in our area, there's no cable service and I'll be damned if I get a satellite dish with 500 stations I don't want to watch.
As it is now I have 1 gig of cell data left on my iPad for the next 3 weeks which if I manage wisely will be just enough to read the local newspaper pdf each morning. Well, the iPhone gets it's 3 gig allotment in a few days so that is enough for basic stuff - like logging in here and ********.
FYI - I tried a software update at MickyD yesterday just for grins - 3 hours remaining, then 2 hours, then 5 hours… Right….
Guess I should be happy iTunes didn't automatically download U2.

My iphone 3gs has started showing the wrong time and date. All was fine until this afternoon when it changed. My apps have the right time and date. However the world clock is wrong. I have to turn off the automatic time setting to get the right time.

My iphone is showing the wrong time and date. All was well until sometime this afternoon when it changed... to Nov 5 (2 days prior to today), and about 9 hours and some minutes before the actual time. The world clock for my time zone shows the same wrong date and time. My calender shows the same wrong date and time. The phone can not find my time zone any more. The only fix I found was to turn off the automatic setting for time. What is happening? Ideas?

just sorted mine went to
settings-mail,contacts,calender-timezone support
then turned it off then on tapped time zone and typed london
this did sort mine

I have iTunes ver 10 on a PC with Playlists which do not sync to ITouch or Nano (6th Gen). All the music does not appear and the playlists do not appear at all. I have selected to manually manage music on the sum tab

I have iTunes ver 10 on a PC with Playlists which do not sync to an Itouch or Nano (6th Gen). Also, all the music does not appear when I check entire library and there is enough memory on the device. When I select to manually manage music on the summary tab and selected playlists on the music tab nothing changes. Either way all the music isn't on either device and the playlists are not on either device. Please advise next steps. Thank you.

Connect the device to the computer.
In iTunes, select the content desired to sync.
Sync.
This is all described in the User's Guide, reading it may be a good place to start.

Compress all dat ain existing table

Hi,
We are using oracle 11.2.0.3 and wish to evaluate performance of compression in terms of reducing time takes for reports aganis the tables to run.
Have had a quick serach and can see alter table compress but talks about only data inserted/updated after the compress operationexecute is compressed.
Don't want to have to create separate table, compressed and replace other table with this.
Is it possible to compress all existing dat aof existing table?
Also what sort of magntitudes of performance gain coudl we expect on report performance by using compression versus identical tabel but uncompressed?
Also this is a data warehouse and the large fact table already has bitmpa indexes which by default compressed.
Tlamking about table compression here.
Thanks
Edited by: user5716448 on 05-Mar-2013 05:57

>
Trying to make reports as fast as possible.
>
Such a blanket 'fast as possible' goal is unrealistic and unattainable. Sounds like a requirement from a business user.
A goal needs to be specific to be attainable. An index that makes one report faster might make several others slower.
A report might run fast one day and slow another, or fast the first week of a new month and slow the last week. The cause might be as simple as the varying amount of monthly data at the start versus the end of the month.
I suggest you itemize your reports and identify a specific goal (SLA - service-level agreement) for each one. Base the goal on the performance you are getting now and state it explicitly: returns results in less than 30 seconds during peak-usage periods (identify a sample peak period).
>
Believe do not need to have a problem in oredr to loook for the most effcient solution.
>
You might want to read that again now that you've had a good night's sleep and a cup of coffee.
A 'solution' cannot exist without a problem: what would it be the solution for?
>
If have quick reports, but can make even quicker that is something we would wnat to do.
>
Back to that again? You need to establish an SLA for each report and only worry about it if it starts failing to meet that SLA.
In other words, for any individual report determine what is 'quick enough' and let it go at that. Things can almost always be made quicker but there can be a big price to pay. Without an SLA for a goal you will have a moving target that can never be met because you can NEVER prove that it couldn't be quicker if you just tweaked it some more.
>
In your experience, all other thinsg being indentical as is good practice with any experment, what sort of performance gains coudl we expect with comnpression and report performance compare to non-compressed data?
Also, in such star queries is it advisable just to compress the central fact table or would the dimesnions benefit from compression?
>
Yes - the benefits can be greater for indexes and dimension tables than for the fact tables themselves. Indexes benefit because fewer index blocks are needed so hot blocks are more likely to be in cache. Same thing with the small dimension (lookup) tables. Fact tables using star-schema data get an additional benefit from the compression of the multiple key values that compress more readily than arbitrary text data like addresses.
The key missing piece of information is that you haven't specified what compression options are availlable to you.
Are you only considering BASIC compression? Or have you licensed Oracle's advanced compression?
http://www.oracle.com/technetwork/database/storage/advanced-compression-whitepaper-130502.pdf

Why does placing links in Illustrator now change the "Date Modified" data for all of my files?

This seems to be a new glitch that started after I installed the latest updates to Illustrator CC (2014) and reoccurs every time on both computers I work on:
When I choose to place a new image in my Illustrator file and the window opens to let me choose a file to place, the "Date Modified" field of all the files in the folder I'm viewing (except other Illustrator files) quickly changes to the current date and time. This is definitely happening when I'm in Illustrator because when I needed files from a folder that had hundreds of images in it and I was able to select a file quickly, I was able to do so before it had changed the date on all of my files. However, when I needed a file from a folder that had hundreds of images in it but I took a long time to find the image I needed, Illustrator had time to change the date modified on all of my files. This might seem like an unimportant issue because it doesn't actually seem to modify or damage any of my files, but having all of the dates change on my files is a serious problem for my workflow and file management issues. So far, my only work around has been to use back-up image files, but that's not a long term solution and I don't understand why Illustrator should be modifying the dates of my files.
Is there a setting I can choose somewhere to prevent this problem? If not, is there somewhere I can report this kind of glitch? I'm not sure if I'm using the exact language necessary to get the issue across so please let me know if you have any questions! Thanks!

iCloud is not compatible with Snow Leopard, that is your problem.
A quick way out is to purchase Soho Organizer which is compatible, even when running on Snow Leopard, it will correctly handle Contacts and Calendars from iCloud. $100, 2 user license.
Soho Organizer
There is a free trial if you want to try it.

All activity prices are manually entered (Message no. KP211 )

Dear All,
I have maintained Activity Rates through KP26. On Activity Master I have set Act. price indicator = 5.
Now when i am executing KSII it is giving me error message as :
All activity prices are manually entered
Message no. KP211
Diagnosis
All activity prices in controlling area FLGP, fiscal year 2011, and version 0 were determined and set as manually entered prices.
In actual price calculation, all plan activity prices, meaning those calculated automatically (activity price indicator 1 and 2) and those set manually (activity price indicator 3), are treated as if they have been set manually.
System Response
The SAP System cannot calculate activity prices automatically.
Processing is cancelled.
Procedure
Check your activity type planning. To calculate the activity price automatically, you must set the activity price indicator accordingly.
Proceed
Please let me know if I need to done any additional settings.
Br, Vivek Srivastava

Hi Vivek,
"The error message KP211 is display by the system due
to the SAP System cannot calculate activity prices automatically.
(can you review the settings in the system).
The procedure that you have to follow is to review transaction code
KP26 and your activity types.
From viewpoint of actual price iteration all plan prices are political
in the sense that 'prices does not change during actual price
iteration'. If all activity types have indicator 1 then everything
will be evaluated with plan price in actual. So actual price iteration
has nothing to compute because no price will be changed. You have to
set price indicator to 5 or 6 in actual price indicator for at least
one activity type in order to calculate the actual activity price.
When you change some activity type master data in transaction KL02,
these changes take effect in all relevant tables, BUT please notice
that the values of TARKZ, TARKZ_I etc. are only DEFAULT values for
activity planning and therefore ONLY READ ONCE when the relevant
planning set is created. Subsequent changes to the master data (default
value) take not effect in the planning sets. You have to change the
values in every single planning set manually."
You indicates that for the activity types you have set in the master data
actual price indicator to 5 (Actual price, automatically based on
on activity). But this is only a default value and can be overwritten
for example during planning.
Please see table COKL for cost center / activity type if have an empty field for
the actual price indicator. Thus the system only finds the plan price
indicators during price calculation and message KP 211 is justified if
you consider the following part of the long text:
In actual price calculation, all plan activity prices, meaning those
calculated automatically (activity price indicator 1 and 2) and
those set manually (activity price indicator 3), are treated as if they
have been set manually.
In order to run KSII as expected by you, you have to execute trans.
KP26 for the cost center and activity type using layout 1-204
(Activity Types: Indicators).
Here you can set the actual price indicator to 5.
Afterwards there should be no further problem with KSII.
I hope helps,
Regards,
MLM

Data Pump data compression

We are seriously looking to begin using data pump and discovered via a metalink bulletin that data pump does not support named pipes or os compression utilities (Doc ID: Note:276521.1). Does anyone know a work around for this or have experience using data pump with very large databases and managing the size of the dmp file.

With oracle datapump, you can set the maximum size of your dumpfile and in this way also dumping on more directories.
I found the following on AskTom website. Ik looks like the things you want are possible with Oracle10g Release 2:
Fortunately, Oracle Database 10g Release 2 makes it easier to create and partially compress DMP files than the old tools ever did. EXPDP itself will now compress all metadata written to the dump file and IMPDP will decompress it automaticallyno more messing around at the operating system level. And Oracle Database 10g Release 2 gives Oracle Database on Windows the ability to partially compress DMP files on the fly for the first time (named pipes are a feature of UNIX/Linux).

How does manual fetching of google contacts and calendar work?

In an effort to possibly save some battery life and/or just use the product as intended I would like to know how this works exactly. At this point I only have two email accounts I use. Yahoo and GMail, with GMail being my primary account. Gmail is the only calendar option I use as well.
I don't add contacts often, nor do I make tons of calendar entrys every day. So when I look into the settings for mail, contacts and calendar, then fetch new data (which shows push as on, which I want) and then advanced, the only two things listed on the fetch schedule are google calendar and google contacts. iCloud and Yahoo mail are listed as push.
So can I set the fetch schedule to manual as opposed to hourly (the longest setting) due to the fact that I am not in constant need or hourly need really of updates to either? Or will calendar notifications fail to show up on time and all my contacts disappear or something?
Battery life or not, if I could have both be "push" I would, as it seems counterintuitive not to, but so does manually looking out every hour for changes to something that likely hasn't changed.

Going to reply to myself on this one, I tryed switching everything to manual fetch today, and at least with respect to contacts, it appears to only go out and sync when the contacts are opening (ie I saw the spinning wheel and watched a contact I had made while in airplane mode on the phone show up online). So I think that it would work the same for calendar entrys.

Using Data Compression on Microsoft SQL 2008 R2

We have a very large database which keeps growing and growing. This has made our upgrade process extremely troublesome because the upgrade wizard seems to require close to 3 times the database size of free space to even start.
As such, we are considering activating DATA COMPRESSION on the PAGE level in Microsoft SQL Server 2008 R2. This technology is native to the SQL Server and compresses the rows and the pages so that they do not take up more space than necessary.
Traditionally each row take up the space of the maximum of all the fields even though only part of a field is filled with data.
[Blog about Data Compression|http://blogs.msdn.com/b/sqlserverstorageengine/archive/2007/11/12/types-of-data-compression-in-sql-server-2008.aspx]
Our idea is to use this initially on the Axxx tables (historic data) to minimize the space they take by using for example:
ALTER TABLE [dbo].[ADO1] REBUILD PARTITION = ALL
WITH (DATA_COMPRESSION = PAGE)
On a test database we have seen tables go from 6GB of space to around 1,5GB which is a significant saving.
MY QUESTION: Is this allowed to do from SAP point of view? The technology is completely transparent but it does involve a rebuild of the table as demonstrated above.
Thanks.
Best regards,
Mike

We are using Simple recovery model, so our log files are pretty small.
Our database itself is about 140GB now and it keeps growing.
We've also reduced the history size to about 10 versions.
Still, some of our tables are 6-10GB.
Some of the advantages of data compression is to also that it improves disk I/O at the cost of slightly higher CPU, which we are pretty sure our server can handle.
Mike

Automatic update does not work

On my both computers (Windows 7, Window 8), the automatic update does not work at all, although it is activated in the options. All I get in the Firefox info box is that an update is available, with a link that I have to follow to download the installation file and install it manually. No difference even if I wait for weeks, the update is neither downloaded nor installed automatically. The problem persists in all Firefox versions since version 3.6.16 / 2011 (the last update in the chronicle). Note that the automatic update seems to perform well in the Windows XP mode of my Windows 7 system !

It will update eventually; there may have been availability problems on the update servers.

How does manual wifi vs. wifi-protected setup differ

I setup my wifi router manually. When I turn on MAC filtering if gives me a warning that I cannot use "wifi-protected" setup.
1) How does manual wifi vs. wifi-protected setup differ?
2) Why does using a manual configuration with MAC Filtering (Allow List) lockout wifi-protected setup?
Thank you,
Ed S.
Solved!
Go to Solution.

Hi edspyhill09. Yes, it will disable Wifi protected setup because you are trying to filter the Mac addresses of the devices that you want to connect to your network. Only those mac addresses that are listed can connect to your network so it defeats the purpose of having WiFi protected setup enable. WiFi protected setup lets users to connect multiple devices to the network and enable data encryption by pushing a button which is most of the time on the front panel or some of them is in the back panel labeled WPS. But WPS doesn't apply to all devices because some gadgets are not WPS capable, only those devices that are WPS capable can take advantage of this feature. Manual wifi is the conventional way of connecting to your wifi network. You look for the network name ssid and connect to it, if it ask for a password, then just type in the password and voila! You're now connected to your wifi network. Hope this helps you out!

My Rebel T3i overexposes in all automatic settings?

When I shoot in automatic setting on my Rebel T3i it overexposes all my shots? What can I do about that?

There can be a couple of reasons for this.
1) In the semi-automatic modes (Program, Tv, and Av) the camera has a feature called "Exposure Compensation". There's a button on the rear of the camera with [Av +/-] on it. This allows you to tell the camera that you want it to exposure the shot brighter or darker than the exposure that the camera would otherwise have selected based on metering.
Exposure compensation has no effect when shooting Manual because when doing Manual, the exposure indicator in the viewfinder (or the rear of the camera) will indicate the "0" position (center position) if your exposure matches what the light meter reads. If you wanted to over-expose or under-expose when shooting manual, you'd just adjust the exposure so the exposure indicator reads higher or lower.
Here's a video demonstrating how to adjust your exposure compensation: https://www.youtube.com/watch?v=ZBOo1aOb3IE
2) It can also be the result of the selected metering method and the subject. The camera has three metering methods... "Evaluative" metering is the default and uses the the full 63 zone metering system. "Center weighted" also uses the entire 63 zone metering system EXCEPT it gives the greatest weight to the meter readings detected in the central area (but not the center point) of the display. Finally there's "Spot" metering. This does not use the full 63 zone metering system and instead just meters the shot based on the light detect in in the very center of the display.
The meter is a "reflected" light meter. It cannot tell how much light is actually falling on a subject... it can only detect the light that reflects off the subject and into the camera. If a subject is dressed completely in black and there's a black background, then the camera detects very little reflection. This makes the camera believe there is not enough light so it will increase the exposure. It "presumes" the image, if thought of as a black and white image, should render as a middle-gray tone. This causes the camera to over-expose the blacks and anything in the image that was not actually black will be strongly over-exposed.
The reverse is also true... take a photo of a subject wearing white on a white snowy background and the camera, thinking the typical scene rendered in black and white should be a middle-gray will think there's too much light. It will compensate by decreasing the exposure and that will cause everything that wasn't actually "white" to be extremely dark and under-exposed.
Hand-held light meters (meters not built into cameras) have a sensor that you simply hold in the very light where your subject is located and it measure the light falling on that point. Those meters detect the true light... not just the light being reflected by the subject. They are extremely accurate -- just not nearly as convenient as the meter built into your camera.
Usually an external hand-held light meter is not necessary... the reflected meter built into the camera is fine as long as YOU remember that very black scenes and subjects tend to over-expose and very white scenes and subjects tend to under-expose. And that's one key reason why you'd actually want to use your camera's exposure compenation.
Tim Campbell
5D II, 5D III, 60Da

Is data compression all automatic? Or does manual steps occur in HANA Studio

Similar Messages

Maybe you are looking for