Consider this as, part of html code that is available <span class = "titlelink"> <a id = "xyz" onclick= "abc" href="#" title = "View this job description"> Associate </a> </span> In my spider file , item["title"] = hs.xpath(".//span[@class = 'titlelink']/a/").extract() gives me the output where as item["title"] = hs.xpath(".//span[@class = 'titlelink']/a/text()").extract() results in empty list. |