How to remove duplicate JSON objects from a list in Python

1 Answer

0 votes
urls = [
  { "url": "https://www.collectivesolver.com/" },
  { "url": "https://www.collectivesolver.com/questions" },
  { "url": "https://www.collectivesolver.com/tags" },
  { "url": "https://www.collectivesolver.com/" },
  { "url": "https://www.collectivesolver.com/" },
  { "url": "https://www.collectivesolver.com/tag/python" },
  { "url": "https://www.collectivesolver.com/" },
  { "url": "https://www.collectivesolver.com/tag/php" },
  { "url": "https://www.collectivesolver.com/tag/java" },     
  { "url": "https://www.collectivesolver.com/tag/java" } 
]

uniqueURLs = { lst['url'] : lst for lst in urls }.values()

print(uniqueURLs)



'''
run:

dict_values([{'url': 'https://www.collectivesolver.com/'}, 
             {'url': 'https://www.collectivesolver.com/questions'}, 
             {'url': 'https://www.collectivesolver.com/tags'}, 
             {'url': 'https://www.collectivesolver.com/tag/python'}, 
             {'url': 'https://www.collectivesolver.com/tag/php'}, 
             {'url': 'https://www.collectivesolver.com/tag/java'}])

'''

 



answered Jun 18, 2020 by avibootz

Related questions

4 answers 272 views
3 answers 254 views
1 answer 191 views
1 answer 229 views
...