cube - SSAS tabluar mode processing fails with "a lot of rows" -



cube - SSAS tabluar mode processing fails with "a lot of rows" -

i have ssas tabular mode cube reads info actian matrix database using odbc. project processes fine when i'm using info set 1 1000000 rows when seek utilize bigger 1 (300 1000000 rows), process runs around 15 minutes , fails message:

the operation failed because source database not exist, source table not exist, or because not have access info source. more details: ole db or odbc error: [paraccel][odbc driver][padb]57014:error: query (25459) cancelled on user's request detail: query (25459) cancelled on user's request ; 57014. error occurred while processing partition 'xxxx' in table 'yyyy'. current operation cancelled because operation in transaction failed.

the message says database doesn't exist doesn't create sense because works fine on first case (and difference "where clause" limit number of rows)

i'm using server has 96 gb of free ran , can see memory beingness consumed while "processing" process running. when consumed, runs few axtra seconds , fails. also, know fact 300 1000000 row dataset exported csv file has 36 gb on raw format, should fit total in memory without compression.

i can guarantee query works fine on own on source database "query (25459) cancelled on user's request" message doesn't create much sense.

does have thought on may going on?

memory consumption on derivative of input rows (the resulting cube) cannot estimated on byte size of input. function of cartesian graph product of distinct values of cube dimensions.

if building cube 2 input rows on 2 dimensions , 2 measurements:

state|city|population --------------------- ny|new york|8406000 ca|los angeles|3884000 state|city|population|number of records --------------------------------------- null|null|12290000|2 ny|null|8406000|1 ny|new york|8406000|1 ca|null|3884000|1 ca|los angeles|3884000|1 null|los angeles|3884000|1 null|new york|8406000|1

you can't expect output beingness generated input info rows processed equivalent in size. if odbc driver keeps entire input in memory before lets read it, have business relationship both input , output reside in memory until cube generation complete.

this reply much clearer on subject: how calculate size of olap cube

ssas cube olap-cube tabular paraccel

Comments

Post a Comment

Popular posts from this blog

assembly - What is the addressing mode for ld, add, and rjmp instructions? -

assembly - What is the addressing mode for ld, add, and rjmp instructions? - hey guys know ldi (load immediate) addressing mode set immediate , st instruction addressing mode set index. however, have no thought others curious are! thanks :) the addressing modes explained in instruction set, in first few pages. in table of instructions see operands instruction determine addressing mode. mode indicated arguments assembly instruction. for example, ld had several different ways of operating, depending on arguments. 1 of them ld rd,x d number of register, such ld r3,x . ld r3,-z else (although both indirect addressing). rjmp k relative addressing, jumping pc + k + 1. add rr,rd direct register addressing. result contained in rd. assembly avr instructions
Read more

vowpalwabbit - Interpreting Vowpal Wabbit results: Why are some lines appended by "h"? -

vowpalwabbit - Interpreting Vowpal Wabbit results: Why are some lines appended by "h"? - below part of log training vw model. why of these lines followed h? you'll notice that's true of "average loss" line in summary @ end. i'm not sure means, or if should care. ... average since illustration illustration current current current loss lastly counter weight label predict features 1.000000 1.000000 1 1.0 -1.0000 0.0000 15 0.500000 0.000000 2 2.0 1.0000 1.0000 15 1.250000 2.000000 4 4.0 -1.0000 1.0000 9 1.167489 1.084979 8 8.0 -1.0000 1.0000 29 1.291439 1.415389 16 16.0 1.0000 1.0000 45 1.096302 0.901166 32 32.0 -1.0000 -1.0000 21 1.299807 1.503312 64 64.0 -1.0000 1.0000 ...
Read more

Php operator `break` doesn't stop while -

Php operator `break` doesn't stop while - have weird issue, break doesn't break while loop , maintain rotating. logically should break cycle , set output while ($c++ != 5) { // here curl request, doesn't relevant have removed preg_match("!<.*?>(\s*)[^<>]*?{$to}<!", $resp, $result) ; // echo 'cnt = ' .count($result).'<br>'; if(!count($result)) { $amount = 0; echo 'sleep called'; sleep(4); exit; continue; } else { $amount = trim(@$result[1]); $amount = round($amount + $amount * $exchange_ratio, $precision); echo 'break happen<br>'; break; } } so output cnt = 2 break happen cnt = 0 sleep called so skipped break , maintain rotating. how so? edit works fine on localhost issue php version? ...
Read more