IOError: [Errno 24] Too many open files

Question

IOError: [Errno 24] Too many open files

Navigation

#1 by (2 votes)

0

When using the

python generator video.mp4 2 150 80 10 thumbnails.jpg

I have the following return

Extracting 734 frames
  [####################################]  100%
Frames extracted.
Traceback (most recent call last):
  File "generator", line 90, in <module>
    generate_video_thumbnail(arguments)
  File "generator", line 39, in generate_video_thumbnail
    generate_sprite_from_frames(outputPrefix, columns, size, output)
  File "generator", line 62, in generate_sprite_from_frames
    images = [Image.open(filename) for filename in framesMap]
  File "C:\Python27\lib\site-packages\PIL\Image.py", line 2312, in open
    fp = builtins.open(filename, "rb")
IOError: [Errno 24] Too many open files: 'c:\users\gpich\appdata\local\temp\tmpellfxjf728913fdda8373761ccb51c69fe51d5_00497.png'

When I need to generate smaller numbers of thumbnails, it generates without problems. How do I get around this?

The project is in github link

below the some functions relevant to the generation

def generate_video_thumbnail(args):
    videoFileClip = VideoFileClip(args['<video>'])
    interval = int(args['<interval>'])
    size = (int(args['<width>']), int(args['<height>']))
    outputPrefix = get_output_prefix()
    generate_frames(videoFileClip, interval, outputPrefix, size)

    columns = int(args['<columns>'])
    output = args['<output>']
    generate_sprite_from_frames(outputPrefix, columns, size, output)


def extract_frame(videoFileClip, moment, outputPrefix, size, frameCount):
    output = outputPrefix + ("%05d.png" % frameCount)
    videoFileClip.save_frame(output, t=int(moment))
    resize_frame(output, size)

def resize_frame(filename, size):
    image = Image.open(filename)
    image = image.resize(size, Image.ANTIALIAS)
    image.save(filename)

def generate_sprite_from_frames(framesPath, columns, size, output):
    framesMap = sorted(glob.glob(framesPath + "*.png"))
    images = [Image.open(filename) for filename in framesMap]
    masterWidth = size[0] * columns
    masterHeight = size[1] * int(math.ceil(float(len(images)) / columns))
    finalImage = Image.new(mode='RGBA', size=(masterWidth, masterHeight), color=(0,0,0,0))
    merge_frames(images, finalImage, columns, size, output)

python thumbnail

asked by anonymous 04.01.2017 / 01:06

1 answer

How to force my variable in php? Create a marker at the current location of Maps with Fragment

score 2 · Accepted Answer

Actually, you are opening all the files for each frame of the video. When doing:

images = [Image.open(filename) for filename in framesMap]

You are generating a list ( images ) with the handles of each file returned by glob of the previous line. So the error.

As I already mentioned in commentary, with a video of 10 minutes recorded at 30 FPS (frames per second), you easily reach 18,000 files open!

Change your code to process file by file, so you do not break the handles limit of your process.

First, change the code of the generate_sprite_from_frames function like this:

def generate_sprite_from_frames(framesPath, columns, size, output):
    framesMap = sorted(glob.glob(framesPath + "*.png"))

    masterWidth = size[0] * columns
    masterHeight = size[1] * int(math.ceil(float(len(framesMap)) / columns))

    finalImage = Image.new(mode='RGBA', size=(masterWidth, masterHeight), color=(0,0,0,0))

    for col, filename in enumerate(framesMap):
        with Image.open(filename) as img:                              
            merge_frames_add(finalImage, image, col, size)

You will need to make a change in the merge_frames function so that it can open an existing spritesheet image with all frames and add the current frame to it. And it can be all in memory: the merge_frames_add function simply copies the current frame in image to the spritesheet image in finalImage in the region of interest (ROI) according to the column in col . >

Note that in the above example I intentionally changed the name to merge_frames_add to denote this change.

As you will process within a block width ... as ... , with each interaction the handle of the file is closed when you exit that block and you will not have any more problems. :)