sql - Apache Hive: converting timestamp from string to timestamp and save it table -



sql - Apache Hive: converting timestamp from string to timestamp and save it table -

i have table in hbase: tableexaple (timestamp, timestamp_string, someotherstuff)

timestamp has datatype timestamp timestamp_string hast datatype string , has pattern 'yyyy-mm-dd hh:mm:ss.sss'

now read value timestamp_string convert hive-udf unix_timestamp(string date, string pattern) timestamp , save in same table value timestamp.

how can this?

stuff like

insert tableexaple (timestamp) select unix_timestamp(timestamp_string, 'yyyy-mm-dd hh:mm:ss.sss') tableexaple;

does not work.

i don't think unix_timestamp likes millisecond format. since timestamp_string of type string, can split on '.' , grab date , time. if had 2014-11-11 08:09:10.123, split(timestamp_string, '\\.') give [2014-11-11 08:09:10, 123]. can reference array [0] , [1].

example:

select otherstuff , timestamp , unix_timestamp(split(timestamp_string, '\\.')[0], 'yyyy-mm-dd hh:mm:ss') new_time some_table

if want include milliseconds in new_time column, grab [1]th index split array (and split 1000).

sql hadoop hive sql-insert

Comments

Post a Comment

Popular posts from this blog

c - Compilation of a code: unkown type name string -

c - Compilation of a code: unkown type name string - i have next lines of code compiler says following: "unknown type name 'string'" both in declaration , definition of function. can tell me what's wrong? thanks. #include <stdio.h> #include <stdlib.h> #include <string.h> void frecognizeclient(string *actualclient) there no string type in c. need utilize array so: char array[10]; then can pass in function: void frecognizeclient(char *actualclient); c arrays string compilation
Read more

ubuntu - Bash Script to Check That Files Are Being Created -

ubuntu - Bash Script to Check That Files Are Being Created - we have amazon ec2 instance upload output our security cameras. every , then, cameras have issue, stop uploaded, , need rebooted. easy way determine seeing if files not beingness created. problem creates lots , lots of files. if utilize find -ctime, takes long time script run. there faster way check see if files have been created since yesterday? need capture result, (yes there files, or not there not,) , email message, nice have didn't take half hr run. #!/bin/bash find /vol/security_ftp/west -ctime -1 find /vol/security_ftp/backentrance -ctime -1 find /vol/security_ftp/boardroomdoor -ctime -1 find /vol/security_ftp/mainentrance -ctime -1 find /vol/security_ftp/north -ctime -1 find /vol/security_ftp/south -ctime -1 using find natural solution, if must avoid it, can see newest file in directory using ls , sorting output according ctime, eg. ls /vol/security_ftp/west -clt | head --lines=1 ...
Read more

Php operator `break` doesn't stop while -

Php operator `break` doesn't stop while - have weird issue, break doesn't break while loop , maintain rotating. logically should break cycle , set output while ($c++ != 5) { // here curl request, doesn't relevant have removed preg_match("!<.*?>(\s*)[^<>]*?{$to}<!", $resp, $result) ; // echo 'cnt = ' .count($result).'<br>'; if(!count($result)) { $amount = 0; echo 'sleep called'; sleep(4); exit; continue; } else { $amount = trim(@$result[1]); $amount = round($amount + $amount * $exchange_ratio, $precision); echo 'break happen<br>'; break; } } so output cnt = 2 break happen cnt = 0 sleep called so skipped break , maintain rotating. how so? edit works fine on localhost issue php version? ...
Read more