https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/INSTRM-1334 Instrument control development <p>With sqlalchemy 1.4, I have Opdb class methods to bulk transfer data in and out of opdb tables, directly to/from pandas DataFrames. We have had other functions to do that, but the older sqlalchemy made that very confusing and odd.</p> INSTRM-1334

Add efficient DataFrame <--> opdb methods

Task Normal Open Unresolved cloomis cloomis Tue, 3 Aug 2021 04:09:40 +0000 Wed, 18 Aug 2021 08:18:47 +0000 spt_operational_database 0 2 <p>I'm taking a look at your implementation (as of Jul 22) but `bulkInsert` does not work for me.</p> <p>I needed to change slightly like:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> buf = io.StringIO() data.to_csv(buf, header=False, index=False) buf.seek(0) sqlCmd = f<span class="code-quote">"COPY {tablename} FROM STDIN WITH (FORMAT CSV)"</span> </pre> </div></div> <p>But still cannot insert anything. There seems to be a problem in</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> with self.engine.connect() as conn: with conn.connection.cursor() as cursor: cursor.copy_expert(sqlCmd, buf) </pre> </div></div> <p>The following works simply but you like to use context manager here...</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> conn = self.engine.raw_connection() cursor = conn.cursor() cursor.copy_expert(sqlCmd, buf) conn.commit() </pre> </div></div> <p>Maybe I'm doing something wrong.</p> Development Rank 0|zzs8u8: