Page 2 of 2 FirstFirst 12
Results 11 to 14 of 14

Thread: Excel 2007 Node

  1. #11
    Lavastorm Employee
    Join Date
    Aug 2009
    Location
    Cologne
    Posts
    513

    Default

    Guys, Any updates on a new node to import .xlsx files?

    thanks, Daniel
    A new fully supported (non-experimental) version of the Excel File node, will be part of LAE 4.5.2 - the next LAE maintenance release on the 4.5 branch. This will handle both .xlsx & .xls flies.

    This release is in the finals iterations of regression testing at the moment and should be available sometime before the end of the month.





    When the worksheet is read in, all columns are changed to unicode. It is possible to indicate the required type for each column? Say to read column 1 as integer, column 2 as double, column 3 as string, etc.
    Unfortunately, there will still be no mechanism for specifying the type on each column. As Rich mentioned, since Excel is cell-based, there is no guarantee that the cells within a column will all have the same format. This means that there is no way to auto-detect the column type. If the user where to specify the column type within the WorkbookSpec parameter, there would also need to be parameters governing what the node should do in case any of the cells within the column cannot be converted to the specified type. However, we will consider these enhancement for future releases.

    Regards,
    Tim.

  2. #12

    Default New Excel File node in LAE 4.5.2

    There's a new Excel File node in LAE 4.5.2 that supports .xlsx files (Excel 2007 and beyond).

    LAE 4.5.2 was released on 22-August-11.

  3. #13

    Default

    We are trying to use excel node but it does not import big excel files. It says "ERROR: Insufficient memory to read the Excel file(s)." There is 74000 record not more than that.

    Any idea or comment?

    Kind Regars,

  4. #14
    Lavastorm Employee
    Join Date
    Aug 2009
    Location
    Cologne
    Posts
    513

    Default

    Hi,

    There is an issue with the Excel File node released with 4.5.2 in that it needs to load the Excel Workbook into memory prior to converting to the LAE internal (BRD) format.

    The issue exists up until LAE 4.5.4.

    This issue has been raised in our bug tracking system and will be fixed in the upcoming LAE 4.5.5 and LAE 4.6.0 releases.

    Until that time, it isn't easy to workaround the limitation.

    Probably the easiest approach is to go into Excel and save the file in a CSV format, then use the CSV file node to read in the data.

    Depending on the size of the file, it is sometimes possible to use multiple Excel File nodes, with the first node reading the first set of rows, the second node reading the next set of rows (e.g. 30,000 rows per node or something), then joining them together with a Cat node. In order to do this, you would need to specify the rows to read in the WorkbookSpec parameter.
    A final alternative is to split the data in the workbook into multiple Excel Files and read each of these separately with an Excel File node in the LAE.

    Obviously, none of these alternatives are ideal and are going to be addressed in the next LAE releases in both LAE 4.5.5, and LAE 4.6.0.

    Regards,
    Tim.

Similar Threads

  1. Replies: 3
    Last Post: 12-23-2011, 12:51 PM
  2. Excel File Node FileName Output
    By Pooja in forum Data Acquisition
    Replies: 2
    Last Post: 08-22-2011, 12:17 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •