In coordination with the ACCESS team, XSEDE has paused the processing of Startup, Education, and other allocation requests from August 17-31. This pause will ensure that no requests are lost while we are making infrastructure updates behind the scenes and handing things over to ACCESS. If you have questions, contact help@xsede.org. The ACCESS team will resume taking allocation requests on September 1 via https://access-ci.org/.

The discussion forums in the XSEDE User Portal are for users to share experiences, questions, and comments with other users and XSEDE staff. Visitors are welcome to browse and search, but you must login to contribute to the forums. While XSEDE staff monitor the lists, XSEDE does not guarantee that questions will be answered. Please note that the forums are not a replacement for formal support or bug reporting procedures through the XSEDE Help Desk. You must be logged in to post to the user forums.

« Back

RE: python memory error on comet

Combination View Flat View Tree View
Threads [ Previous | Next ]
python memory error on comet
Answer
11/13/16 9:34 AM
Hi, I am a new Xsede user, so sorry if this is a dumb question. I am using the comet cluster. I am getting a memory error in python for loading a 1.3 GB file even through there is more than enough memory in the system. I checked that I am also using the 64 bit version of python in the comet cluster. Is there a system check that stops an application from using too much memory and restricts the usage? Thanks.
Flag

RE: python memory error on comet
Answer
6/19/20 7:04 AM as a reply to Ashish Agrawal.
A memory error means that your program has ran out of memory. If you get an unexpected MemoryError and you think you should have plenty of RAM available, it might be because you are using a 32-bit python installation. This could be caused by either the 2GB per program limit imposed by Windows (32bit programs), or lack of available RAM on your computer. The easy solution, if you have a 64-bit operating system, is to switch to a 64-bit installation of python. The issue is that 32-bit python only has access to ~4GB of RAM. This can shrink even further if your operating system is 32-bit, because of the operating system overhead.
Flag