Python Web Scraping: List all language names and number of related articles in the order they appear in wikipedia

Last update on May 28 2022 13:13:56 (UTC/GMT +8 hours)

Python Web Scraping: Exercise-12 with Solution

Write a Python program to list all language names and number of related articles in the order they appear in wikipedia.org.

Sample Solution:

Python Code:

from urllib.request import urlopen
from bs4 import BeautifulSoup
html = urlopen('https://www.wikipedia.org/')
bs = BeautifulSoup(html, "html.parser")
nameList = bs.findAll('a', {'class' : 'link-box'})
for name in nameList:
  print(name.get_text())

Sample Output:

English
5 675 000+ articles


日本語
1 111 000+ 記事


Español
1 427 000+ artículos


Deutsch
2 195 000+ Artikel


Русский
1 481 000+ статей


Français
1 997 000+ articles


Italiano
1 446 000+ voci


中文
1 012 000+ 條目


Português
1 000 000+ artigos


Polski
1 288 000+ haseł

Flowchart:

Python Code Editor:

Have another way to solve this solution? Contribute your code (and comments) through Disqus.

Previous: Write a Python program to check whether a page contains a title or not.
Next: Write a Python program to get the number of people visiting a U.S. government website right now.

What is the difficulty level of this exercise?

Python: Tips of the Day

Find current directory and file's directory:

To get the full path to the directory a Python file is contained in, write this in that file:

import os 
dir_path = os.path.dirname(os.path.realpath(__file__))

(Note that the incantation above won't work if you've already used os.chdir() to change your current working directory, since the value of the __file__ constant is relative to the current working directory and is not changed by an os.chdir() call.)

To get the current working directory use

import os
cwd = os.getcwd()

Documentation references for the modules, constants and functions used above:

The os and os.path modules.
The __file__ constant
os.path.realpath(path) (returns "the canonical path of the specified filename, eliminating any symbolic links encountered in the path")
os.path.dirname(path) (returns "the directory name of pathname path")
os.getcwd() (returns "a string representing the current working directory")
os.chdir(path) ("change the current working directory to path")

Ref: https://bit.ly/3fy0R6m