Extraer contenido de <Script con BeautifulSoup

1 / Estoy intentando extraer una parte del guión usando una sopa hermosa, pero no imprime nada. Que pasa

URL = "http://www.reuters.com/video/2014/08/30/woman-who-drank-restaurants-tainted-tea?videoId=341712453" oururl= urllib2.urlopen(URL).read() soup = BeautifulSoup(oururl) for script in soup("script"): script.extract() list_of_scripts = soup.findAll("script") print list_of_scripts 

2 / El objective es extraer el valor del atributo “transcripción”:

  { "@context": "http://schema.org", "@type": "VideoObject", "video": { "@type": "VideoObject", "headline": "Woman who drank restaurant's tainted tea hopes for industry...", "caption": "Woman who drank restaurant's tainted tea hopes for industry...", "transcript": "Jan Harding is speaking out for the first time about the ordeal that changed her life. SOUNDBITE: JAN HARDING, DRANK TAINTED TEA, SAYING: \"Immediately my whole mouth was on fire.\" The Utah woman was critically burned in her mouth and esophagus after taking a sip of sweet tea laced with a toxic cleaning solution at Dickey's BBQ. SOUNDBITE: JAN HARDING, DRANK TAINTED TEA, SAYING: \"It was like a fire beyond anything you can imagine. I mean, it was not like drinking hot coffee.\" Authorities say an employee mistakenly mixed the industrial cleaning solution containing lye into the tea thinking it was sugar. The Hardings hope the incident will bring changes in the restaurant industry to avoid such dangerous mixups. SOUNDBITE: JIM HARDING, HUSBAND, SAYING: \"Bottom line, so no one ever has to go through this again.\" The district attorney's office is expected to decide in the coming week whether criminal charges will be filed.", 

extract quitar etiqueta de la dom. Es por eso que obtienes la lista vacía.


Busque el script con el atributo type="application/ld+json" y descodifíquelo utilizando json.loads . Luego, puede acceder a los datos como la estructura de datos de Python. (dictado por los datos dados)

 import json import urllib2 from bs4 import BeautifulSoup URL = ("http://www.reuters.com/video/2014/08/30/" "woman-who-drank-restaurants-tainted-tea?videoId=341712453") oururl= urllib2.urlopen(URL).read() soup = BeautifulSoup(oururl) data = json.loads(soup.find('script', type='application/ld+json').text) print data['video']['transcript']