Large scale mail transfer

I'm looking for a convenient way to transfer a lot of mail (~100K messages, lots of sub mail boxes) between accounts on two OS X mail servers. Using a mail client is slow and results in lots of aborts with dumb errors like "NUL characters encountered". I have physical access to both machines and am guessing that there should be a simple way to transfer a whole tree of mail by copying files in the right places (using an external drive). Any help would be much appreciated.

Create the account on the second server and log in at least once to make sure the inbox is created. Then, you can backup and restore that user from /var/spool/imap/user/douglas. Make sure to maintain the ownership and privileges. Once it is in place on the new server, you can then tell Cyrus to rebuild its databases based on the contents with:
sudo /usr/bin/cyrus/bin/reconstruct -rf user/douglas
The only side effect is that all messages in all folders will be marked as Unread.

Similar Messages

Very-large-scale searching in J2EE

I'm looking to solve a very-large-scale searching problem. I am creating a site
where users can search a table with five million records, filtering and sorting
independantly on ten different columns. For example, the table might be five million
customers, and the user might choose "S*" for the last name, and sort ascending
on street name.
I have read up on a number of patterns to solve this problem, but anticipate some
performance issues. I'll explain below:
1) "Page-by-Page Iterator" or "Value List Handler"
In this pattern, it appears that all records that match the search criteria are
retrieved from the database and cached on the application server. The client (JSP)
can then access small pieces of the cached results at a time. Issues with this
include:
- If the customer record is 1KB, then wide search criteria (i.e. last name =
S*) will cause 1 GB transfer from the database server to app server, and then
1GB being stored on the app server, cached, waiting for the user (each user!)
to ask for the next 10 or 100 records. This is inefficient use of network and
memory resources.
- 99% of the data transfered from the database server will not by used ... most
users flip through a couple of pages and then choose a record or start a new search
2) Requery the database each time and ask for a subset
I haven't seen this formalized into a pattern yet, but the basic idea is this:
If a clients asks for records 1-100 first (i.e. page 1), only fetch that many
records from the db. If the user asks for the next page, requery the database
and use the JDBC API's ResultSet.absolute(int row) to start at record 101. Issue:
The query is re-performed, causing the Oracle server to do another costly "execute"
(bad on 5M records with sorting).
To solve this, I've beed trying to enhance the second strategy above by caching
the ResultSet object in a stateful session bean. Unfortunately, this causes a
"ResultSet already closed" SQLException, although I ensure that the Connection,
PreparedStatement, and ResultSet are all stored in the EJB and not closed. I've
seen this on newsgroups ... it appears that WebLogic is forcing the Connection
closed. If this is how J2EE and pooled connections work, then that's fine ...
there's nothing I can really do about it.
Another idea is to use "explicit cursors" in Oracle. I haven't fully explored
it yet, but it wouldn't be a great solution as it would be using Oracle-specific
functionality (we are trying to be db-agnostic).
More information:
- BEA WebLogic Server 8.1
- JDBC: Oracle's thin driver provided with WLS 8.1
- Platform: Sun Solaris 5.8
- Oracle 9i
Any other ideas on how I can solve this issue?

Michael McNeil wrote:
I'm looking to solve a very-large-scale searching problem. I am creating a site
where users can search a table with five million records, filtering and sorting
independantly on ten different columns. For example, the table might be five million
customers, and the user might choose "S*" for the last name, and sort ascending
on street name.
I have read up on a number of patterns to solve this problem, but anticipate some
performance issues. I'll explain below:
1) "Page-by-Page Iterator" or "Value List Handler"
In this pattern, it appears that all records that match the search criteria are
retrieved from the database and cached on the application server. The client (JSP)
can then access small pieces of the cached results at a time. Issues with this
include:
- If the customer record is 1KB, then wide search criteria (i.e. last name =
S*) will cause 1 GB transfer from the database server to app server, and then
1GB being stored on the app server, cached, waiting for the user (each user!)
to ask for the next 10 or 100 records. This is inefficient use of network and
memory resources.
- 99% of the data transfered from the database server will not by used ... most
users flip through a couple of pages and then choose a record or start a new search
2) Requery the database each time and ask for a subset
I haven't seen this formalized into a pattern yet, but the basic idea is this:
If a clients asks for records 1-100 first (i.e. page 1), only fetch that many
records from the db. If the user asks for the next page, requery the database
and use the JDBC API's ResultSet.absolute(int row) to start at record 101. Issue:
The query is re-performed, causing the Oracle server to do another costly "execute"
(bad on 5M records with sorting).
To solve this, I've beed trying to enhance the second strategy above by caching
the ResultSet object in a stateful session bean. Unfortunately, this causes a
"ResultSet already closed" SQLException, although I ensure that the Connection,
PreparedStatement, and ResultSet are all stored in the EJB and not closed. I've
seen this on newsgroups ... it appears that WebLogic is forcing the Connection
closed. If this is how J2EE and pooled connections work, then that's fine ...
there's nothing I can really do about it.
Another idea is to use "explicit cursors" in Oracle. I haven't fully explored
it yet, but it wouldn't be a great solution as it would be using Oracle-specific
functionality (we are trying to be db-agnostic).
More information:
- BEA WebLogic Server 8.1
- JDBC: Oracle's thin driver provided with WLS 8.1
- Platform: Sun Solaris 5.8
- Oracle 9i
Any other ideas on how I can solve this issue? Hi. Fancy SQL to the rescue! If the table has a unique key, you can simply send a
query per page, with iterative SQL that selects the next N rows beyond what was
selected last time. Eg:
Let variable X be the highest key value you've seen so far. Initially it would
be the lowest possible value.
select * from mytable M
where ... -- application-specific qualifications...
and M.key >= X
and (100 <= select count(*) from mytable MM where MM.key > X and MM.key < M.key and ...)
In English, this says, select all the qualifying rows higher than what I last saw, but
only those that have fewer than 100 qualifying rows between the last I saw and them (ie:
the next 100).
When processing this query, remember the highest key value you see, and use it for the
next query.
Joe

Hi, My printing has suddenly changed in adobe to a large scale, as in, what should be one page of print comes out as 24 pages? I havent changed anything, its happening on more than one document also, I have to stop my printer before all the pages spew o

Hi, My printing has suddenly changed in adobe to a large scale, as in, what should be one page of print comes out as 24 pages? I havent changed anything, its happening on more than one document also, I have to stop my printer before all the pages spew out. I have tried printing 'one single page' and it does exactly the same? Help?

Is the Poster Print feature turned ON?

When printing from an online PDF, the page prints in extra large scale. How do I fix this?

when printing from an online PDF, the page prints in extra large scale. How do I fix this?

This can happen when Firefox has misread the paper size from the information supplied by Windows. Clearing it can involve finding some obscure settings, but here goes:
(1) In a new tab, type or paste '''about:config''' in the address bar and press Enter. Click the button promising to be careful.
(2) In the search box above the list, type or paste '''print''' and pause while the list is filtered
(3) For each setting for the problem printer, right-click and Reset it. The fastest way is to right-click with the mouse and then press the r key on the keyboard with your other hand.
Note: In a couple other threads involving Brother printers, the preference '''printer_printer_name.print_paper_data''' was set to 256 and when the user edited it to 1 that fixed the paper size problem. If you see a 256 there, you can edit the value by doubling-clicking it or using right-click>Modify.

Line appears when applying drop shadow on large scale

Hello!
Some weeks ago I had to make a large scale graphic (800mmx2000mm) for a roll-up banner. I wanted to apply a drop shadow to a rounded shape, and ugly lines came up. Since it was a bit urgent, I decided not to use it.
But now I'm curious, so I quickly made an ellipse and added a shadow, so you know what I mean. This also happens when I save it as pdf or image.
Perhaps someday I will have to use a drop shadow on large scale. So, does anybody knows how to fix this or what could I do in case I need to use this effect in these conditions? I use Illustrator CS6 in Mac with Mavericks.
Thanks in advance.

Mike Gondek wrote:
I was able to create an ellipse to your dimension and got a good drop shadow. What happens if you manually make a drop shadow using appearance?
FYI I tried making the same using drop shadow filter in CS5 and got this error.
Incase your file was created in CS5 and opened in 6, I would recreate the drop shadow in CS6. I know they redid the gaussian blur in CS6, but not sure if that affected drop shadow.
CS6 is better on raster effects at large sizes.
My file was created and opened in CS6.
My ellipse is around 175cmx50cm. I tried it manually like you said and got the same results:
So, I guess I'm alone with such a problem. No idea what is wrong :/

Tweaking product prices on a large scale - how?

My Client has a software store on BC. His supplier is constantly changing their prices and my client wants to be able to quickly review prices, make changes to reflect supplier prices every few days
If I export the Product List the Excel export is unusable with it full of HTML markup from the product descriptions.
Apart from opening each product individually to check and tweak prices how is everyone ammending prices on a large scale.... My client only has 60 products at the moment but this is soon to quadruple and I have prospective clients looking at BC for their ecommerce solution and they have thousands of items.
Regards
Richard

If its just prices you want to input, see if you can just eliminate all the other columns that are not needed and only import the price column with its product identifier ofcourse, and see if it will just update the price and not have to deal with the descriptions...Just a thought...

What design aids for large-scale application (using LV6i) exist?

I have a large-scale application that includes analog and digital I/O, motion control, multiple temperature readings, Ethernet communication, RS-232, DDE and ActiveX controls for communicating with other commercial software. We have to improve the system performance and ease the pain of maintaining and upgrading. What aids are there for large-scale application design and development?

This doesn't exactly count as development "tools" but I can send you copies of three papers that I found when I was just getting started with LV. They can show you how to think about your problem--and that is really the hardest (and most important) part.
Contact me directly and I'll email them to you. The archive is to large to post.
Mike...
Certified Professional Instructor
Certified LabVIEW Architect
LabVIEW Champion
"... after all, He's not a tame lion..."
Be thinking ahead and mark your dance card for NI Week 2015 now: TS 6139 - Object Oriented First Steps

Large Scale Digital Printing Guidelines

Hi,
I'm trying to get a getter handle on the principles and options for creating the best large and very large scale prints from digital files. I'm more than well versed in the basics of Photoshop and color management but there remain some issues I've never dealt with.
It would be very helpful if you could give me some advice about this issue that I've divided into four levels. In some cases I've stated principles as I understand them. Feel free to better inform me. In other cases I've posed direct questions and I'd really appreciate professional advice about these issues, or references to places where I can learn more.
Thanks alot,
Chris
Level one – Start with the maximum number of pixels possible.
Principle: Your goal is to produce a print without interpolation at no less than 240 dpi. This means that you need as many pixels as the capture device can produce at its maximum optical resolution.
Level two – Appropriate Interpolation within Photoshop
Use the Photoshop Image Size box with the appropriate interpolation setting (Bicubic Smoother) to increase the image size up to the maximum size of your ink jet printer.
What is the absolute minimum resolution that is acceptable when printing up to 44”?
What about the idea of increasing your print size in 10% increments? Does this make a real difference?
Level three - Resizing with vector-based applications like Genuine Fractals?
In your experience do these work as advertized and do you recommend them for preparing files to print larger than the Epson 9900?
Level four – Giant Digital Printing Methods
What are the options for creating extremely large digital prints?
Are there web sites or other resources you can point me to to learn more about this?
How do you prepare files for very large-scale digital output?

While what you say may be true, it is not always the case. I would view a 'painting' as more than a 'poster' in terms of output resolution, at least in the first stages of development. Definately get the info from your printer and then plan to use your hardware/software setup to give you the most creative flexibility. In other words - work as big as you can (within reason, see previous statement) to give yourself the most creative freedom. Things like subtle gradations and fine details will benefit from more pixels, and can with the right printer be transferred to hard copy at higher resolutions (a photo quality ink jet will take advantage of 600ppi) if that's what you're going for.
Additionally it's much easier to down scale than to wish you had a bigger image after a 100 hours of labor...

Applying Oil Paint Filter to Large Scale Images

I need to apply the effects available from the Oil Paint filter to very large, 80mb images. The filter works exactly as I need it to on small images, but not at large scale. A comment I have heard in a Lynda.com video on the Oil Paint filter mentioned that the filter does not work well on large images. However, I REALLY need this, even if I need to pay someone to write a program that can do it! Does anyone know if / how I can get the filter to work for large images and / or if there is a third-party plug-in that will provide the same results? Having this filter work on large scale images could make or break a business idea I have so finding a solution is extremely important to me.

What's the problem you're having with applying it to an 80 MB image? Is it that the effects don't scale up enough?
Technically it can run on large images if you have the computer resources... I've just successfully applied it to an 80 MB image, and with the sliders turned all the way up it looks pretty oil painty, though it kind of drops back into a realistic looking photo when zoomed out...
If it's just that the sliders can't go high enough, given that it's a very abstract look you're trying to achieve, have you considered applying it at a downsized resolution, then upsampling, then maybe applying it again? This is done that way...
Oh, and by the way, Oil Paint has been removed from Photoshop CC 2014, so if you're planning a business based on automatically turning people's large photos into oil paintings you should assume you'll be stuck with running the older Photoshop version.
-Noel

6.0.1 ready for large scale deployment?

I have a 210 we are in the process of migrating to, at the end of the migration we will have 700 or so 2800 IOS firewalls. We are half way through the process and already MARS is having CPU issues, although I think this may be bug related. Is 6.0.1 ready for a large scale deployment and heavy load? Im hoping this may bring the cpu down a little but I do not want to introduce other issues.
Thanks

I ended up doing a clean install of a MARS50, originally 4.3.6, and still have problems with graphgen shutting down.
I have no support on my MARS 50 so I'm stuck waiting for a possible future upgrade beyond 6.0.1. It's odd that the same ISO install gives different results on the same hardware. MARS in not exactly an "appliance" like a PIX but still...ISO based installations should produce identical installations
/Fredrik

About shell scripts for large-scale automation of encoding tasks

in the user menu of Compressor, it said that we can use the command line to write shell scripts for large-scale automation of encoding tasks.
I would like to have more information about the shell script for compressor, is that any document link?
Thanks

You can use a script function to set-up a more secure environment that you call at the start of every admin script. This could be your main stamp album for stuff that can be moved there.
A few more stamps to add to the collection (be sure to read up on them before use):
1) reset the command hash
hash -r
2) prevent core dumps
ulimit -H -c0
3) set the IFS
4) clear all aliases (see unalias -a)
Also you can remove the ALL from sudo and add explicit commands to the the sudoers file. There's a lot of fine tuning you can do in sudoers - inc. env variables as teekay said.
But I'm no expert so best to check all of the above.

Compiling a large scale application

I have recently aquired a large scale application with nearly 300 .java files. The problem I'm having is compiling such a large application where every class seems to be dependent on other classes and packages. Is there a simple solution to compiling such an app or do I have to use brute force and trial and error until I get all the packages and files compiled? The route I am taking now is going to each folder and making txt files that I pass to javac ("javac @currdir.txt") and if i get linking errors, track those files down and try to compile them first.
thanks in advance,
Bosco

There are numerous tools out there that will help you, and most IDE's have some notion of a "project"--a set of files that goes together and that may depend on each other.
Personally I like ant, from the fine people at Apache/Jakarta.
http://ant.apache.org/

Please help: large scale Printing question

A Client asked me to do a backdrop for a play that is 10' high by 18' wide. She wont give me the number of where shes getting it printed from for some stupid reason so i cant ask them directly, my question which is this: What size and format should my photoshop file be in for large scale printing like that? Right now my file is 10" high by 18" wide and 300dpi. and its a Psd right now of course. Any help would be awesome.

hu instinct,
Basically, when scaled the artwork has identical appearences at identical proportional distances (looks as if it has the same resolution); in other words: when you look at a 1:1 print of your present 10x18" artwork at a certain distance, the 10x18' backdrop will look the same to the audience/actors/instructor/whoever at 12 times the distance, so if it looks nice to you at 1' or 1.5' or2', it will look just as nice to them at 12' or 15' or 18'.

Working w/ large scale AI files

What is the best way to work with large scale (wall mural) files that contain many gradients, shadows. etc. Any manipulations take a considerable time to redraw. Files are customer created, and we are then manipulating from there in-house. We have some fairly robust machines ( mac pro towers- 14GB RAM, RAID scratch disk).. I would guess there is a way to work in a mode that does not render effects, allowing for faster manipulation? Any help would be great- and considerably help reduce our time.
First post- sorry if did something wrong- question / title wise/
THX!

In a perfect world, the customers would be creating their Illustrator artwork with the size & scale of the final image in mind. It's very difficult to get customers (who often have no formal graphic design training and are self taught at learning Illustrator & Photoshop) to think about the basic rule of designing for the output device -a graphics 101 sort of thing.
Something like a large wall mural, especially one that is reproduced outdoors, can get by just fine with Illustrator artwork using raster effects settings of 72ppi or even less than that. Lots of users will have a 300ppi setting applied. 300ppi is fine for a printed page being viewed up close. 300ppi is sheer overkill for large format use.
Mind you, Adobe Illustrator has a 227" X 227" maximum artboard size, so anything bigger than that will have to be designed at a reduced scale with appropriate raster effects settings applied. For example, I'll design a 14' X 48' billboard at a 1" = 1' scale. A 300ppi raster effects setting is OK in that regard. When blown up in a large format printing RIP the raster based effects have an effective 25ppi resolution, but that's good enough for a huge panel being viewed by speeding vehicles on city streets or busy highways.
Outside of that, the render speed of vector-based artwork will depend on the complexity of artwork. One "gotcha" I tend to watch are objects with large numbers of anchor points (like anything above 4000 points). At a certain point the RIP might process only part of the object or completely disregard it.

Flex deployed on a large scale?

We plan on developing a new product and Flex popped in my
mind as a development platform. I know a good deal of Flex 1.5, but
only used it for personal sites.
My question is how well Flex behaves in a large scale
environment to those who have deployed it in such. Server load will
be at least thousand / day.
Thanks!

Hmm... I made one medium sized application in 1.5 (approx 10
screens, user access <1000 times per day) and it seems to be
working alright for the client.
Now I am working on a major application (over 20 main
screens, and definately access>1000 times per day) and it is not
going well. I am really worried about the bugs and memory issues of
Flex 2.0. I have also not found a sure-fire way to address these
potential issues. I can say this: for the size of application we
are making, Flex and Flash Player just aren't up to the job.
Compiled and executed as a single .swf application results in 755MB
ram usage and for some reason a constant CPU access of 60% (Pentium
4 proc.) after accessing every screen. And this is just FlashPlayer
doing what it is supposed to. Me, not being a computer engineer,
can't really address these problems. Flex and AS aren't C. I can't
control memory usage with my code. By breaking up the huge
application into smaller ones and then loading those via an
SWFLoader I may be able to avoid this rampant resource hogging but
it's sort of illogical from an application architecture standpoint
because this is ONE application.
As a developer, I can see plenty of places to streamline the
application but this simply isn't possible when dealing with the
client. They want this screen to look and act this way and that
screen to look and act the other way. I can talk about how if both
screens use the same layout and logic they can both use the same
template class, share static resources, blah blah until I am blue
in the face but it won't matter because they are the client and
they decide how the application is going to look--at the expense of
streamlining. That's just the real world. Then I have to somehow
make it work.
By the way... before you think "just use view states!", I do
use those--and bitwise logic flags for more complicated
configurations--it's still not enough, although it did cut approx
160 screens in documentation form down to just 20 in
implementation.
In worst case scenarios, I have to deny the client what they
want and if they ask me why, I have to reply "it can't be done with
Flex". Then their satisfaction in the product drops. Flex suddenly
isn't as incredible as it seemed at first. Doesn't matter how
pretty and animated the screens are when if you run them over an
hour your computer slows to a halt or .ttc fonts stop loading (HUGE
issue here in Japan).
I have yet to see a sample application that comes close to
the scale of our current project: A library book browser? neat but
that's just square one; A Commodore 64 emulator? cute. no place in
business; A real-estate browswer? in our project that would be the
equivalent of ONE SCREEN out of the entire application.
I like Flex. It's fun--on a small scale. But I never want to
develop a real world business application using it again. There are
way more (and way more skilled) Java, JSP, PHP, etc. etc.
developers out there than Flex developers who can make much more
robust applications. It's a shame the client got caught up in the
hype of Flex RIA before the technology was ready for the task.
Very long story short: Beware using Flex for an involved
application.
It's going to require exponentially more time than a smaller,
less ambitious project--especially if you don't purchase FDS. And
oh my god implementing a Flex application on a legacy Struts
framework... kill me now! As much as I hate "page-refresh"
applications, Flex (both 1.5 and 2.0) has not proven to be the
god-send that I had hoped and dreamed it would be as a developer.
What can you expect, though? It's only been out a few years.... And
as far as clients' perspectives go, the price for FDS also
certainly doesn't help make it appealing. That is why it is so
embarrassing to tell them their dream application is quickly
becoming an egregious memory hog.
Anyway, good luck if you take on your project with flex. Just
be careful!

Large scale mail transfer

Similar Messages

Maybe you are looking for