a question about spark notebook about plot

[江之源]

hi~

I am sorry to bother you.

Now i load a file and use the sql to do some count in sql, they are all successful. But i cannot plot the lines which makes me confused.

I’ll paste some information and i hope you can help me to fix this small question.

In [66]:

val Text = sc.textFile("/Users/alexjzy/Downloads/tmp/scores.txt")

case class scores(overall:Double)

val result = Text.map(s=>s.split(" ")).map(

    s=>scores(s(1).toDouble

        )

    )

​

​

Text: org.apache.spark.rdd.RDD[String] = MapPartitionsRDD[173] at textFile at <console>:21
defined class scores
result: org.apache.spark.rdd.RDD[scores] = MapPartitionsRDD[175] at map at <console>:23

Out[66]:MapPartitionsRDD[175] at map at <console>:23

In [67]:

result.toDF().registerTempTable("result")

​

Out[67]:

In [68]:

:sql[scores] SELECT overall, count(1) FROM result GROUP BY overall ORDER BY overall

import notebook.front.widgets.Sql
import notebook.front.widgets.Sql._
scores: notebook.front.widgets.Sql = <Sql widget>

Out[68]:

[overall: double, c1: bigint]

In the Out[68] i can see the scores including overall and c1, overall is the score and c1 is the number of the score.

 and furthermore i do the react operation and i can see the list of data. My question is how can i plot my overall and c1 in the chart??!!

Below is my data, please help me 

THX~

In [45]:

 val a = scores.react[String](

  rddResult => rddResult.collect().toList.toString,// → change date to Long then keep count as Long

  out//use wisp updatebd with result of the previous function

)

a: notebook.front.SingleConnectedWidget[String] = <anon$2 widget>

Out[45]:

List([0.0,33], [0.1,2], [0.2,3], [0.3,2], [0.4,2], [0.5,1], [0.6,6], [0.7,2], [0.8,4], [0.9,7], [1.1,2], [1.2,4], [1.3,3], [1.4,3], [1.5,3], [1.6,3], [1.7,1], [1.8,1], [1.9,5], [2.0,3], [2.1,3], [2.2,4], [2.3,6], [2.4,5], [2.5,3], [2.6,6], [2.7,3], [2.8,5], [2.9,5], [3.0,4], [3.1,4], [3.2,3], [3.3,2], [3.4,5], [3.5,5], [3.6,1], [3.7,9], [3.8,3], [3.9,6], [4.0,6], [4.1,5], [4.2,4], [4.3,7], [4.4,8], [4.5,7], [4.6,7], [4.7,4], [4.8,8], [4.9,11], [5.0,889], [5.1,31], [5.2,33], [5.3,37], [5.4,32], [5.5,35], [5.6,32], [5.7,33], [5.8,36], [5.9,33], [6.0,36], [6.1,27], [6.2,23], [6.3,28], [6.4,37], [6.5,33], [6.6,45], [6.7,36], [6.8,38], [6.9,36], [7.0,24], [7.1,28], [7.2,36], [7.3,36], [7.4,29], [7.5,35], [7.6,28], [7.7,31], [7.8,39], [7.9,30], [8.0,32], [8.1,38], [8.2,29], [8.3,40], [8.4,32], [8.5,26], [8.6,43], [8.7,35], [8.8,35], [8.9,34], [9.0,34], [9.1,35], [9.2,26], [9.3,35], [9.4,41], [9.5,33], [9.6,30], [9.7,20], [9.8,38], [9.9,45], [10.0,33], [10.1,42], [10.2,37], [10.3,41], [10.4,29], [10.5,49], [10.6,33], [10.7,52], [10.8,48], [10.9,43], [11.0,57], [11.1,58], [11.2,40], [11.3,35], [11.4,44], [11.5,70], [11.6,65], [11.7,67], [11.8,59], [11.9,73], [12.0,72], [12.1,91], [12.2,82], [12.3,78], [12.4,68], [12.5,72], [12.6,95], [12.7,88], [12.8,97], [12.9,113], [13.0,96], [13.1,79], [13.2,126], [13.3,130], [13.4,131], [13.5,107], [13.6,155], [13.7,129], [13.8,154], [13.9,143], [14.0,110], [14.1,206], [14.2,167], [14.3,194], [14.4,238], [14.5,170], [14.6,194], [14.7,210], [14.8,181], [14.9,264], [15.0,337], [15.1,189], [15.2,220], [15.3,277], [15.4,235], [15.5,216], [15.6,226], [15.7,243], [15.8,284], [15.9,285], [16.0,234], [16.1,296], [16.2,225], [16.3,261], [16.4,264], [16.5,419], [16.6,286], [16.7,290], [16.8,267], [16.9,300], [17.0,299], [17.1,346], [17.2,309], [17.3,323], [17.4,346], [17.5,406], [17.6,322], [17.7,360], [17.8,420], [17.9,332], [18.0,341], [18.1,420], [18.2,363], [18.3,473], [18.4,440], [18.5,437], [18.6,456], [18.7,433], [18.8,431], [18.9,523], [19.0,453], [19.1,526], [19.2,470], [19.3,438], [19.4,977], [19.5,523], [19.6,514], [19.7,674], [19.8,508], [19.9,1918], [20.0,2527], [20.1,541], [20.2,547], [20.3,2599], [20.4,632], [20.5,613], [20.6,863], [20.7,1416], [20.8,662], [20.9,1139], [21.0,801], [21.1,737], [21.2,1485], [21.3,734], [21.4,839], [21.5,1293], [21.6,795], [21.7,930], [21.8,891], [21.9,988], [22.0,1006], [22.1,837], [22.2,891], [22.3,956], [22.4,955], [22.5,989], [22.6,944], [22.7,935], [22.8,938], [22.9,925], [23.0,1013], [23.1,1023], [23.2,997], [23.3,954], [23.4,1058], [23.5,990], [23.6,1056], [23.7,967], [23.8,1037], [23.9,1065], [24.0,1075], [24.1,1030], [24.2,1106], [24.3,1041], [24.4,1093], [24.5,1096], [24.6,1033], [24.7,1060], [24.8,1074], [24.9,1066], [25.0,1123], [25.1,1154], [25.2,1075], [25.3,1171], [25.4,1140], [25.5,1159], [25.6,1848], [25.7,1165], [25.8,1213], [25.9,1300], [26.0,1171], [26.1,1250], [26.2,1311], [26.3,1240], [26.4,1269], [26.5,1291], [26.6,1249], [26.7,1298], [26.8,1415], [26.9,1343], [27.0,1342], [27.1,1385], [27.2,1339], [27.3,1370], [27.4,1405], [27.5,1420], [27.6,1432], [27.7,1436], [27.8,1423], [27.9,1481], [28.0,1420], [28.1,1467], [28.2,1562], [28.3,1514], [28.4,1531], [28.5,1514], [28.6,1539], [28.7,1591], [28.8,1652], [28.9,1489], [29.0,1586], [29.1,1683], [29.2,1641], [29.3,1670], [29.4,1651], [29.5,1676], [29.6,1657], [29.7,1732], [29.8,1698], [29.9,1751], [30.0,3433], [30.1,1844], [30.2,1740], [30.3,1814], [30.4,1772], [30.5,1814], [30.6,2119], [30.7,1911], [30.8,1921], [30.9,1881], [31.0,1955], [31.1,1909], [31.2,2121], [31.3,1930], [31.4,1884], [31.5,1909], [31.6,1987], [31.7,2005], [31.8,1909], [31.9,2041], [32.0,1991], [32.1,2069], [32.2,1999], [32.3,2081], [32.4,2089], [32.5,2116], [32.6,2098], [32.7,2163], [32.8,2186], [32.9,2137], [33.0,2098], [33.1,2222], [33.2,2121], [33.3,2296], [33.4,2130], [33.5,2183], [33.6,2196], [33.7,2122], [33.8,2186], [33.9,2187], [34.0,2273], [34.1,2197], [34.2,2271], [34.3,2278], [34.4,2228], [34.5,2399], [34.6,2308], [34.7,2342], [34.8,2298], [34.9,2330], [35.0,2284], [35.1,2398], [35.2,2483], [35.3,2371], [35.4,2362], [35.5,2408], [35.6,3186], [35.7,2465], [35.8,2401], [35.9,2535], [36.0,2482], [36.1,2494], [36.2,2634], [36.3,2585], [36.4,2561], [36.5,2536], [36.6,2625], [36.7,2627], [36.8,2619], [36.9,2735], [37.0,2650], [37.1,2673], [37.2,2727], [37.3,2808], [37.4,2843], [37.5,2637], [37.6,2912], [37.7,2744], [37.8,2806], [37.9,2813], [38.0,2837], [38.1,2766], [38.2,2879], [38.3,2881], [38.4,2936], [38.5,2884], [38.6,2793], [38.7,2844], [38.8,2938], [38.9,2939], [39.0,2980], [39.1,2997], [39.2,3056], [39.3,3076], [39.4,3034], [39.5,2949], [39.6,2990], [39.7,3070], [39.8,3178], [39.9,3048], [40.0,3160], [40.1,3124], [40.2,3105], [40.3,3157], [40.4,3248], [40.5,3299], [40.6,3185], [40.7,3223], [40.8,3227], [40.9,3209], [41.0,3240], [41.1,3275], [41.2,3292], [41.3,3288], [41.4,3349], [41.5,3347], [41.6,3378], [41.7,3459], [41.8,3474], [41.9,3461], [42.0,3531], [42.1,3552], [42.2,3467], [42.3,3452], [42.4,3586], [42.5,3516], [42.6,3493], [42.7,3741], [42.8,3673], [42.9,3674], [43.0,3721], [43.1,3733], [43.2,3648], [43.3,3771], [43.4,3750], [43.5,3745], [43.6,3763], [43.7,3858], [43.8,3811], [43.9,3854], [44.0,3980], [44.1,3915], [44.2,3863], [44.3,3942], [44.4,4013], [44.5,3975], [44.6,4125], [44.7,4107], [44.8,4160], [44.9,4103], [45.0,4085], [45.1,4221], [45.2,4265], [45.3,4194], [45.4,4262], [45.5,4426], [45.6,4312], [45.7,4411], [45.8,4225], [45.9,4396], [46.0,4502], [46.1,4546], [46.2,4437], [46.3,4389], [46.4,4496], [46.5,4536], [46.6,4545], [46.7,4517], [46.8,4723], [46.9,4577], [47.0,4634], [47.1,4734], [47.2,4704], [47.3,4701], [47.4,4723], [47.5,4938], [47.6,4934], [47.7,4980], [47.8,4987], [47.9,4923], [48.0,4899], [48.1,5012], [48.2,5000], [48.3,4912], [48.4,5048], [48.5,5084], [48.6,5079], [48.7,5268], [48.8,5168], [48.9,5322], [49.0,5326], [49.1,5244], [49.2,5455], [49.3,5338], [49.4,5519], [49.5,5553], [49.6,5377], [49.7,5498], [49.8,5545], [49.9,5578], [50.0,5655], [50.1,5725], [50.2,5696], [50.3,5691], [50.4,5660], [50.5,5958], [50.6,5814], [50.7,5954], [50.8,5838], [50.9,6028], [51.0,6084], [51.1,6097], [51.2,6069], [51.3,6196], [51.4,6109], [51.5,6226], [51.6,6302], [51.7,6443], [51.8,6335], [51.9,6455], [52.0,6564], [52.1,6528], [52.2,6634], [52.3,6541], [52.4,6718], [52.5,7033], [52.6,6914], [52.7,6825], [52.8,6869], [52.9,6891], [53.0,7059], [53.1,6799], [53.2,7046], [53.3,7058], [53.4,7156], [53.5,7306], [53.6,7304], [53.7,7372], [53.8,7299], [53.9,7344], [54.0,7357], [54.1,7378], [54.2,7517], [54.3,7636], [54.4,7720], [54.5,7552], [54.6,7751], [54.7,7993], [54.8,8022], [54.9,7951], [55.0,8060], [55.1,8099], [55.2,8170], [55.3,8162], [55.4,8229], [55.5,8120], [55.6,8304], [55.7,8414], [55.8,8492], [55.9,8504], [56.0,8659], [56.1,8690], [56.2,8764], [56.3,8899], [56.4,8900], [56.5,9047], [56.6,9027], [56.7,8954], [56.8,9143], [56.9,9154], [57.0,9245], [57.1,9523], [57.2,9370], [57.3,9266], [57.4,9689], [57.5,9679], [57.6,9756], [57.7,9840], [57.8,9940], [57.9,10044], [58.0,9954], [58.1,10148], [58.2,10289], [58.3,10115], [58.4,10200], [58.5,10431], [58.6,10403], [58.7,10555], [58.8,10610], [58.9,10821], [59.0,10740], [59.1,10885], [59.2,10936], [59.3,10927], [59.4,11086], [59.5,11092], [59.6,11440], [59.7,11322], [59.8,11599], [59.9,11725], [60.0,11700], [60.1,11898], [60.2,11908], [60.3,11839], [60.4,12139], [60.5,12060], [60.6,12254], [60.7,12117], [60.8,12338], [60.9,12553], [61.0,12586], [61.1,12782], [61.2,12699], [61.3,12740], [61.4,12931], [61.5,13010], [61.6,13189], [61.7,13166], [61.8,13391], [61.9,13445], [62.0,13497], [62.1,13829], [62.2,13765], [62.3,13787], [62.4,14071], [62.5,14272], [62.6,14200], [62.7,14256], [62.8,14430], [62.9,14263], [63.0,14632], [63.1,14865], [63.2,14764], [63.3,14866], [63.4,14944], [63.5,14983], [63.6,15164], [63.7,15369], [63.8,15376], [63.9,15441], [64.0,15525], [64.1,15982], [64.2,15956], [64.3,16082], [64.4,16002], [64.5,16314], [64.6,16541], [64.7,16574], [64.8,16558], [64.9,16622], [65.0,16815], [65.1,16987], [65.2,17072], [65.3,17223], [65.4,17440], [65.5,17639], [65.6,17452], [65.7,17727], [65.8,17791], [65.9,18214], [66.0,18289], [66.1,17969], [66.2,18397], [66.3,18195], [66.4,18609], [66.5,18521], [66.6,18952], [66.7,18926], [66.8,19108], [66.9,19230], [67.0,19558], [67.1,19538], [67.2,19685], [67.3,19790], [67.4,19923], [67.5,19842], [67.6,20072], [67.7,20040], [67.8,20522], [67.9,20522], [68.0,20721], [68.1,20800], [68.2,20994], [68.3,20979], [68.4,21078], [68.5,20997], [68.6,21198], [68.7,21751], [68.8,21712], [68.9,21826], [69.0,21987], [69.1,22008], [69.2,22076], [69.3,21928], [69.4,22558], [69.5,22393], [69.6,22403], [69.7,23050], [69.8,22924], [69.9,22988], [70.0,23129], [70.1,22911], [70.2,23376], [70.3,23737], [70.4,23897], [70.5,23852], [70.6,23947], [70.7,23982], [70.8,24045], [70.9,24334], [71.0,24348], [71.1,24677], [71.2,24515], [71.3,24887], [71.4,24984], [71.5,24900], [71.6,25007], [71.7,24986], [71.8,25415], [71.9,25569], [72.0,25624], [72.1,25823], [72.2,25915], [72.3,25892], [72.4,25969], [72.5,26295], [72.6,26233], [72.7,26518], [72.8,26458], [72.9,26735], [73.0,26915], [73.1,26774], [73.2,27206], [73.3,27248], [73.4,27603], [73.5,27454], [73.6,27305], [73.7,27575], [73.8,27849], [73.9,27892], [74.0,27922], [74.1,28091], [74.2,28413], [74.3,28398], [74.4,28306], [74.5,28354], [74.6,28391], [74.7,28562], [74.8,28749], [74.9,28999], [75.0,29220], [75.1,29094], [75.2,29263], [75.3,29156], [75.4,29556], [75.5,29539], [75.6,29527], [75.7,29483], [75.8,29875], [75.9,29838], [76.0,30005], [76.1,30259], [76.2,30456], [76.3,30130], [76.4,30486], [76.5,30424], [76.6,30588], [76.7,30857], [76.8,30587], [76.9,30761], [77.0,31291], [77.1,31264], [77.2,31330], [77.3,31513], [77.4,31450], [77.5,31579], [77.6,31911], [77.7,31705], [77.8,31863], [77.9,32006], [78.0,32025], [78.1,32068], [78.2,31880], [78.3,32664], [78.4,32324], [78.5,32624], [78.6,32371], [78.7,32677], [78.8,32515], [78.9,32375], [79.0,32654], [79.1,32704], [79.2,32800], [79.3,33273], [79.4,33104], [79.5,32961], [79.6,33403], [79.7,32900], [79.8,33408], [79.9,33528], [80.0,33695], [80.1,33346], [80.2,33499], [80.3,33800], [80.4,33920], [80.5,33861], [80.6,34065], [80.7,34189], [80.8,34091], [80.9,34361], [81.0,34286], [81.1,34471], [81.2,34187], [81.3,34227], [81.4,34344], [81.5,34503], [81.6,34757], [81.7,34851], [81.8,34842], [81.9,35158], [82.0,34846], [82.1,35532], [82.2,35163], [82.3,35090], [82.4,34811], [82.5,35598], [82.6,35318], [82.7,35347], [82.8,35351], [82.9,35511], [83.0,35730], [83.1,35632], [83.2,35631], [83.3,35649], [83.4,35630], [83.5,35901], [83.6,36099], [83.7,36095], [83.8,36034], [83.9,35696], [84.0,36087], [84.1,36082], [84.2,36198], [84.3,36041], [84.4,35793], [84.5,35843], [84.6,36027], [84.7,35761], [84.8,36154], [84.9,36222], [85.0,36278], [85.1,36593], [85.2,36150], [85.3,36229], [85.4,36395], [85.5,36049], [85.6,36530], [85.7,35930], [85.8,35949], [85.9,36182], [86.0,36204], [86.1,36377], [86.2,36143], [86.3,36208], [86.4,36125], [86.5,36126], [86.6,35956], [86.7,36049], [86.8,35937], [86.9,35895], [87.0,35871], [87.1,35797], [87.2,35994], [87.3,35792], [87.4,35858], [87.5,35758], [87.6,35908], [87.7,35775], [87.8,35757], [87.9,35777], [88.0,35397], [88.1,35830], [88.2,35426], [88.3,35440], [88.4,35436], [88.5,35412], [88.6,35759], [88.7,35912], [88.8,35387], [88.9,35809], [89.0,35508], [89.1,35452], [89.2,35655], [89.3,35710], [89.4,36122], [89.5,36073], [89.6,35845], [89.7,36027], [89.8,36366], [89.9,36087], [90.0,36353], [90.1,36088], [90.2,36277], [90.3,36538], [90.4,36399], [90.5,36370], [90.6,36625], [90.7,36337], [90.8,36368], [90.9,36413], [91.0,36567], [91.1,36607], [91.2,36553], [91.3,36646], [91.4,36550], [91.5,36725], [91.6,37096], [91.7,36693], [91.8,36711], [91.9,36889], [92.0,36610], [92.1,36477], [92.2,36085], [92.3,36519], [92.4,36558], [92.5,36381], [92.6,36576], [92.7,36395], [92.8,36371], [92.9,35842], [93.0,35560], [93.1,35617], [93.2,35995], [93.3,35180], [93.4,35158], [93.5,35210], [93.6,34867], [93.7,34655], [93.8,34595], [93.9,34790], [94.0,34617], [94.1,34124], [94.2,33916], [94.3,33489], [94.4,33210], [94.5,32935], [94.6,32458], [94.7,31937], [94.8,30992], [94.9,30500], [95.0,29543], [95.1,28328], [95.2,27476], [95.3,26263], [95.4,25068], [95.5,23862], [95.6,22851], [95.7,21315], [95.8,20332], [95.9,18988], [96.0,17933], [96.1,16448], [96.2,15323], [96.3,13776], [96.4,12889], [96.5,11990], [96.6,10969], [96.7,10182], [96.8,8648], [96.9,6662], [97.0,5808], [97.1,5034], [97.2,4215], [97.3,3810], [97.4,3369], [97.5,2899], [97.6,2567], [97.7,2449], [97.8,2192], [97.9,2000], [98.0,1834], [98.1,1830], [98.2,1736], [98.3,1577], [98.4,1426], [98.5,1244], [98.6,1117], [98.7,1022], [98.8,889], [98.9,792], [99.0,713], [99.1,679], [99.2,619], [99.3,550], [99.4,557], [99.5,481], [99.6,432], [99.7,291], [99.8,244], [99.9,165], [100.0,523])

[andy petrella]

Hello, sorry for the late reply, it'd be great if you'd create an issue with the notebook, so I can reply if it's possible, and how directly in the notebook :-D

It's gonna be easier than over mail IMHO

wdyt?

andy

--
You received this message because you are subscribed to the Google Groups "spark-notebook-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to spark-notebook-...@googlegroups.com.
To post to this group, send email to spark-not...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/spark-notebook-user/B0466313-5DDA-43D0-883A-D7F27F8C28A1%40liulishuo.com.
For more options, visit https://groups.google.com/d/optout.