Hi all,
We're having a problem using the SQL import software to import user to site mappings. Small tests seem to work but bigger files (the main file we have is around 12,000 records) crash with a memory error. Even splitting the files down so we only process a hundred records at a time can often give us the same issue.
We used the same process (just using different SQL and config files) to successfully import all 12,000 users and link them to their primary site.
Here's the error we are getting....
runtime stack:
runtime.throw(0x877140, 0xd)
C:/SPF/Go/src/runtime/panic.go:547 +0x7f
runtime.(*mcache).refill(0xf10000, 0x5, 0x61c7bbd0)
C:/SPF/Go/src/runtime/mcache.go:121 +0xce
runtime.mallocgc.func2()
C:/SPF/Go/src/runtime/malloc.go:642 +0x2b
runtime.systemstack(0x11232000)
C:/SPF/Go/src/runtime/asm_386.s:313 +0x5e
runtime.mstart()
C:/SPF/Go/src/runtime/proc.go:1051
We then get many thousands of lines of debug information thrown out (essentially reporting every remaining line failing)
I've attached the config file we are using.
Looking at the memory usage of the application it constantly grows and crashes when it hits around 1.4Gb. The PC it's running on still had 8Gb of RAM available and we get the same issue if we try it on another computer.
Looking at the log file there is nothing of any use and the routine stops at the update customer line each time, here's the last snippet in case it helps... (customer specific info removed)
2017/08/17 16:21:26 [DEBUG] User ID: #100
2017/08/17 16:21:26 [DEBUG] Update Customer: #1
2017/08/17 16:21:26 [DEBUG] 2017/08/17 15:21:26 [MESSAGE] SQL Attribute for Org Lookup: ############
2017/08/17 15:21:26 [DEBUG] Found Org in Cache #############
2017/08/17 15:21:26 [DEBUG] User: #1 Already Added to Organisation: ##############
2017/08/17 15:21:26 [DEBUG] Processing User Profile Data #1
2017/08/17 15:21:26 [DEBUG] User Profile Update Success
2017/08/17 16:21:26 [DEBUG] User ID: #101
Fingers crossed someone can help!.
Many thanks,
Darren
config 2 - user import to link to org structure - Copy.json