Question

How to parse JSON file into a list and remove duplicate objects in Python

Answer 1

import json

with open('data.json') as f:
     urls = json.load(f)

uniqueURLs = { lst['url'] : lst for lst in urls }.values()
 
print(uniqueURLs)
 



'''
run:

dict_values([{'url': 'https://www.collectivesolver.com/'}, 
             {'url': 'https://www.collectivesolver.com/questions'}, 
             {'url': 'https://www.collectivesolver.com/tags'}, 
             {'url': 'https://www.collectivesolver.com/tag/python'}, 
             {'url': 'https://www.collectivesolver.com/tag/php'}, 
             {'url': 'https://www.collectivesolver.com/tag/java'}])

'''

 

70+ SQL courses for beginners and professionals