r - Merging two data tables with two id variables and NA values -


i merge following data tables 

dt1 <- data.table(id = letters[1:5], day = 1, var1 = c(2,5,8,7,9), var2 = c(5,5,8,6,7), key = "id") dt2 <- data.table(id = letters[3:7], day = 2, var1 = c(1,7,6,6,3), var2 = c(2,3,3,2,1), key = "id")

and results should include each id, each of days. unfortunately, ids not present on days. 

id day var1 var2   1   2   5   2   na  na b   1   5   5 b   2   na  na c   1   8   8 c   2   1   2 d   1   7   6 d   2   7   3

i have tried setting id , day keys both dt. following lines don't manage day 2 id missing, , variables doubled (var1.x var1.y) 

merge(dt1, dt2, by= c("id","day"), all=true) merge(dt1, dt2, by= c("day","id"), all=true)

the allow.cartesian doesn't work either. has idea/comment on how final table need?

try

library(data.table) dcast(melt(rbind(dt1, dt2), id=c('id', 'day')),          id+day~variable, value.var='value', drop=false) # 1:    1    2    5 # 2:    2   na   na # 3:  b   1    5    5 # 4:  b   2   na   na # 5:  c   1    8    8 # 6:  c   2    1    2 # 7:  d   1    7    6 # 8:  d   2    7    3 # 9:  e   1    9    7 #10:  e   2    6    3 #11:  f   1   na   na #12:  f   2    6    2 #13:  g   1   na   na #14:  g   2    3    1

or @bramvisser commented, replace rbind(dt1, dt2) rbindlist(list(dt1, dt2))

or approach without using melt/dcast

rbindlist(list(dt1, dt2))[, if(.n <2) .sd[c(.n, .n+1)] else .sd, id][,     day:=replace(day, is.na(day), setdiff(1:2,na.omit(day))) , id][]

or

setkey(rbindlist(list(dt1, dt2)), id, day)[cj(id=unique(id), day=unique(day))]

Comments

Post a Comment

Popular posts from this blog

cakephp - simple blog with croogo -

i not problem, made simple blog in croogo, problem is not adding or modifying or delete, because arabic language ?? function add in controller `public function admin_add() { $this->set('title_for_layout', __('add part')); if (!empty($this->request->data)) { $this->part->create(); if ($this->part->save($this->request->data)) { $this->session->setflash(__('the part has been saved'), 'default', array('class' => 'success')); $this->redirect(array('action' => 'index'));//, $this->part->id)); } else { $this->session->setflash(__('the part not saved. please, try again.'), 'default', array('class' => 'error')); } } }` => model `class part extends appmodel { public $name = 'part'; var $belongst...
Read more

How to group boxplot outliers in gnuplot -

i have large set of data points. try plot them boxplot, of outliers exact same value , represented on line beside each other. found how set horizontal distance between outliers in gnuplot boxplot , doesn't much, apparently not possible. is possible group outliers together, print 1 point , print number in brackets beside indicate how many points there are? think make more readable in graph. for information, have 3 boxplots 1 x value , times 6 in 1 graph. using gnuplot 5 , played around pointsize, doesn't reduce distance anymore. hope can help! edit: set terminal pdf set output 'dat.pdf' file0 = 'dat1.dat' file1 = 'dat2.dat' file2 = 'dat3.dat' set pointsize 0.2 set notitle set xlabel 'x' set ylabel 'y' header = system('head -1 '.file0); n = words(header) set xtics ('' 1) set [i=1:n] xtics add (word(header, i) i) set style data boxplot plot file0 using (1-0.25):1:(0.2) boxplot lw 2 lc rgb '#8b0000...
Read more

bash - Performing variable substitution in a string -

i have string contains use of variable, , i'd substitute variable's value string. right best have is #!/bin/bash foo='$name; echo bar' name="the name" expanded="$(eval echo "$foo")" echo "$expanded" which has obvious defects: prints the name bar while i'd print the name; echo bar instead of eval can bash's regex matching bash's string replacement: foo='$name; echo bar' name="the name" [[ "$foo" =~ \$([[:alnum:]]+) ]] && s="${!bash_rematch[1]}" && expanded="${foo/\$${bash_rematch[1]}/$s}" echo "$expanded" name; echo bar
Read more