[*] You just use mutate_each / muate_all library(dplyr) df <- data.frame(x=c(1, 2, 3), y = c(-4, 5, 6), z = c(42, 42, 42)) sdf <- copy_to(sc, df, overwrite=TRUE) mutate_all(sdf, funs(. – mean(.))) Source: query [3 x 3] Database: spark connection master=local[*] app=sparklyr local=TRUE x y z <dbl> <dbl> <dbl> 1 -1 -6.333333 0 2 0 … Read more
You can install directly from a GitHub repository: if (!require(‘devtools’)) install.packages(‘devtools’) devtools::install_github(‘apache/[email protected]’, subdir=”R/pkg”) You should choose tag (v2.x.x above) corresponding to the version of Spark you use. You can find a full list of tags on the project page or directly from R using GitHub API: jsonlite::fromJSON(“https://api.github.com/repos/apache/spark/tags”)$name If you’ve downloaded binary package from a downloads … Read more