I will give an example to explain my doubt:
I need to retrieve image information from an API, this image bank returns JSON's with information of the images I need, in total there are 33 million images and I will request 100 in 100 thousand.
The structure of a JSON if I ordered 2 images would be:
{
"meta":{
"limit":2,
"offset":0,
"total_count":33640457
},
"objects":[
{
"artist":"sunyyasyed",
"grid_thumb_url":"http://grid.unlistedimages.com/64830460.jpg",
"id":64830460,
"image_name":"k13762459",
"preview_url":"http://comps.unlistedimages.com/ulcomp/CSP/CSP992/k13762459.jpg",
"ratio":0.8895689,
"resource_uri":"/api/v1.0/image/64830460/",
"subscription_allowed":true,
"thumbnail_url":"http://photos.unlistedimages.com/thumbs/CSP/CSP992/k13762459.jpg",
"title":"100 Business, Web, and Office Icons",
"type":"PHOTO"
},
{
"artist":"kevron2001",
"grid_thumb_url":"http://grid.unlistedimages.com/62322357.jpg",
"id":62322357,
"image_name":"k10882629",
"preview_url":"http://comps.unlistedimages.com/ulcomp/CSP/CSP990/k10882629.jpg",
"ratio":1.25,
"resource_uri":"/api/v1.0/image/62322357/",
"subscription_allowed":true,
"thumbnail_url":"http://photos.unlistedimages.com/thumbs/CSP/CSP990/k10882629.jpg",
"title":"Sunset with open Bible",
"type":"PHOTO"
}
]
}
Each image block has 13 lines, or at the end JSON will have ~ 1,300,000 lines, is there a limit to generate a JSON file? it may be that this file (with 43MB of text) can cause problems if I need to read it