[問題] shiny讀取大檔案csv會當機

看板R_Language作者Esmelee (Esme)時間6年前 (2017/10/21 21:42)推噓4(4推 0噓 50→)

留言54則, 5人參與討論串1/2 (看更多)

文章分類提示: - 問題:shiny [問題類型]: 程式諮詢(我想用R 做某件事情，但是我不知道要怎麼用R 寫出來) [軟體熟悉度]: 入門(寫過其他程式，只是對語法不熟悉) [問題敘述]: 我做了一個shiny讀取歷年資料的程式可是我的csv檔案有2gb大發現讀取可以，可是要用shiny+套件時就會當機如果不用shiny就可以正常繪圖了有人建議我用mysql可是我把資料弄進mysql，mysql就當機了檔案太大嗎??只有2g阿到底要怎麼用才能正常在shiny上跑呢我的記憶體有16g 我是不是要用甚麼spark hadoop的就會跑得出來而且後端檔案有2g大網站要怎麼做呢 shinyapps.io好像不可能... [程式範例]: library(leaflet) library(shiny) library(shinydashboard) library(readr) library(methods) library(DT) library(RCurl) alldata_2010 <- read_csv("alldata_test.csv", col_types = cols(PM2.5 = col_number(), year = col_character(), month = col_character(), day = col_character(), hour = col_character())) ui <- fluidPage( titlePanel("Basic DataTable"), fluidRow( column(4, selectInput("year", "year:", alldata_2010, selectize=TRUE) ), column(4, selectInput("month", "month:", alldata_2010, selectize=TRUE) ), column(4, selectInput("day", "day:", alldata_2010, selectize=TRUE) ), column(4, selectInput("hour", "hour:", alldata_2010, selectize=TRUE) ), fluidRow( title = "data MAP", collapsible = TRUE, width = "100%", height = "100%", leafletOutput("datamap", height = "900px") ) ) ) server <- function(input, output) { output$datamap <- renderLeaflet({ data <- alldata_2010 if (input$year != "all") { data <- data[data$year == input$year,] } if (input$month != "All") { data <- data[data$month == input$month,] } if (input$day != "All") { data <- data[data$day == input$day,] } if (input$hour != "All") { data <- data[data$hour == input$hour,] } cPal <- colorNumeric(palette = c("green","orange","red","purple"),domain = 0:100) leaflet(taiwan) %>%addProviderTiles(providers$CartoDB.Positron) %>% addPolygons(color = "#444444", weight = 1.5, smoothFactor = 1.5, opacity = 1.5, fillOpacity = 0.1) %>% addCircleMarkers(lng=data$TWD97Lon,lat=data$TWD97Lat, radius=13,stroke=FALSE, fillOpacity = 0.9, fillColor = ~cPal(data$PM2.5), label =~as.character(data$PM2.5), popup = ~as.character(data$site))%>% addLegend("bottomright", pal = cPal, values =data$PM2.5,title = "PM2.5", labFormat = labelFormat(suffix = " "),opacity = 1) } ) } shinyApp(ui = ui, server = server) [環境敘述]: R version 3.3.3 windows 10 記憶體16gb [關鍵字]:shiny 資料大 -- ※ 發信站: 批踢踢實業坊(ptt.cc), 來自: 220.132.6.162 ※ 文章網址: https://www.ptt.cc/bbs/R_Language/M.1508593359.A.BE4.html

→

celestialgod

10/21 21:55, 6年前 , 1^F

10/21 21:55, 1^F

→

celestialgod

10/21 21:55, 6年前 , 2^F

10/21 21:55, 2^F

→

celestialgod

10/21 21:56, 6年前 , 3^F

10/21 21:56, 3^F