Pandas: Remove the html tags within the specified column of a given DataFrame

Last update on May 28 2022 13:02:47 (UTC/GMT +8 hours)

Pandas: String and Regular Expression Exercise-41 with Solution

Write a Pandas program to remove the html tags within the specified column of a given DataFrame.

Sample Solution:

Python Code :

import pandas as pd
import re as re
df = pd.DataFrame({
    'company_code': ['Abcd','EFGF', 'zefsalf', 'sdfslew', 'zekfsdf'],
    'date_of_sale': ['12/05/2002','16/02/1999','05/09/1998','12/02/2022','15/09/1997'],
    'address': ['9910 Surrey <b>Avenue</b>','92 N. Bishop Avenue','9910 <br>Golden Star Avenue', '102 Dunbar <i></i>St.', '17 West Livingston Court']
})
print("Original DataFrame:")
print(df)
def remove_tags(string):
    result = re.sub('<.*?>','',string)
    return result
df['with_out_tags']=df['address'].apply(lambda cw : remove_tags(cw))
print("\nSentences without tags':")
print(df)

Sample Output:

Original DataFrame:
  company_code             ...                                   address
0         Abcd             ...                 9910 Surrey Avenue
1         EFGF             ...                       92 N. Bishop Avenue
2      zefsalf             ...               9910 
Golden Star Avenue
3      sdfslew             ...                     102 Dunbar St.
4      zekfsdf             ...                  17 West Livingston Court

[5 rows x 3 columns]

Sentences without tags':
  company_code            ...                        with_out_tags
0         Abcd            ...                   9910 Surrey Avenue
1         EFGF            ...                  92 N. Bishop Avenue
2      zefsalf            ...              9910 Golden Star Avenue
3      sdfslew            ...                       102 Dunbar St.
4      zekfsdf            ...             17 West Livingston Court

[5 rows x 4 columns]

Python Code Editor:

Have another way to solve this solution? Contribute your code (and comments) through Disqus.

Previous: Write a Pandas program to extract words starting with capital words from a given column of a given DataFrame.

What is the difficulty level of this exercise?

Test your Programming skills with w3resource's quiz.

Python: Tips of the Day

Find current directory and file's directory:

To get the full path to the directory a Python file is contained in, write this in that file:

import os 
dir_path = os.path.dirname(os.path.realpath(__file__))

(Note that the incantation above won't work if you've already used os.chdir() to change your current working directory, since the value of the __file__ constant is relative to the current working directory and is not changed by an os.chdir() call.)

To get the current working directory use

import os
cwd = os.getcwd()

Documentation references for the modules, constants and functions used above:

The os and os.path modules.
The __file__ constant
os.path.realpath(path) (returns "the canonical path of the specified filename, eliminating any symbolic links encountered in the path")
os.path.dirname(path) (returns "the directory name of pathname path")
os.getcwd() (returns "a string representing the current working directory")
os.chdir(path) ("change the current working directory to path")

Ref: https://bit.ly/3fy0R6m