I was having the same problem for a while. I had just migrated to another vps and was running nginx in place of apache. I thought it was an issue with that, that the php-fpm was not configured properly. Turns out I just had to edit my /etc/php.ini file to increase the amount of memory it could use. Tweaked a few other settings there, all is good it seems.
Here is the diff
--- php.ini 2011-06-01 22:30:13.000000000 +0400 +++ php.ini 2011-06-01 22:31:26.000000000 +0400 @@ -300,7 +300,7 @@
max_execution_time = 90 ; Maximum execution time of each script, in seconds
max_input_time = -1 ; Maximum amount of time each script may spend parsing request data
;max_input_nesting_level = 64 ; Maximum input variable nesting level
-memory_limit = 64M ; Maximum amount of memory a script may consume (16MB)
+memory_limit = 16M ; Maximum amount of memory a script may consume (16MB)
set_time_limit = 0
;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;