r - Concatenating two database tables out-of-memory with dplyr -
I am using dplyr to manipulate two tables on the database. Without downloading the table data locally, I have two tables in other words just add out-of-memory / database, the database resources are given two
& gt; TBL (DB_SCR, "DB_table_1") ABC1-2.2246894-1.48167912-1.650 99363 2 0.5559320 -0.878 9 8575 -0.15634590 3 1.8469466 -0.01487524 -0.53098215 4 -0.6875051 0.23880967 0.01824621 5 -0.6735163 0.75485292 0.44154092 & gt; Tbl (db_src, "db_table_2") AC 1 memory 0.4287284 -0.3295925 2 0.5201492 0.3341251 3 -2.6355570 1.7916780 4 -1.3645337 1.3642276 5 -0.4954542 -0.6660001 I get (in the database / Out) ):
& gt; tbl (db_src, "db_table_concatenated") ABC 1 -0.2246894 -1.48167912106676 -1.65099363 2 0.5559320 -0.878985746842256 -0.15634590 3 1.8469466 -0.0148752354840942 -0.53098215 4 -0, 6875051 0.238809666690982 0.01824621 5 -0.6735163 0.754852923524198 0.44154092 6 0.4287284 NA -0.32 9 5 9 248 7 0.52014 9 2 NA 0.33412510 8 -2k63,55,570 NA 1.79167801 9 -1.3645337 NA 1.36422764 10 -0.4954542 NA -066600006 My current implementation of dplyr :: rbind_list uses, but Detafrem for download in the memory Required to: Connect to database source: db_src & lt; - src_postgres (dbname = dbname, host = host, port = port, user = user, password = password) # Load table from database source 1: db_tbl_1 & lt; - tbl (db_src, "db_table_1") # Load table 2 from database source: db_tbl_2 & lt; - tbl (db_src, "db_table_2") # write the data db: db_tbl_concatenated & lt; - rbind_list (as.data.frame (db_tbl_1, n = -1), as.data.frame (db_tbl_2, n = -1)) in memory / local solutions
What it Is an out-of-memory / in-database solution?
Comments
Post a Comment