Author Topic: Import of large model from an external source  (Read 159 times)

michielper

  • EA User
  • **
  • Posts: 105
  • Karma: +1/-0
    • View Profile
Import of large model from an external source
« on: April 11, 2019, 09:12:26 pm »
I want to import a very large class model, consisting of 100.000+ elements and relationships from a non-EA SQL database into Sparx EA. What is the best way to do this?
I know there is a VBA importer to import from an Excel spreadsheet (written by Geert Bellekens) but that is probably not scalable enough. My idea is that it should be possible to create an XML file that can be imported as XMI. Is this possible? And what exactly is the format I must use?
And what about the relationships? All elements have of course already a unique ID, how can I use that to create the right relationships in EA? EA will want to assign its own GUID of course and the relationships must contain the EA GIUD, not the original ID.

Any help or suggestions are highly appreciated!

qwerty

  • EA Guru
  • *****
  • Posts: 10134
  • Karma: +207/-165
  • I'm no guru at all
    • View Profile
Re: Import of large model from an external source
« Reply #1 on: April 11, 2019, 10:04:23 pm »
I suggest to hire Geert to do that for you.

q.

Arshad

  • EA User
  • **
  • Posts: 172
  • Karma: +10/-1
    • View Profile
Re: Import of large model from an external source
« Reply #2 on: April 11, 2019, 10:22:44 pm »
Give a Try with

Sparx Excel Importer in MDG Integration For Microsoft Office


  • Create all the objects in a single click
  • Create Diagrams in each package level
  • Create connectors based on the profile definition
  • Profile definition based import
  • Live progress bar showing the status of the import
  • Synchronization


Sparx Systems India - Services
Profile | Training PlansConsulting

Geert Bellekens

  • EA Guru
  • *****
  • Posts: 8981
  • Karma: +234/-27
  • Make EA work for YOU!
    • View Profile
    • Enterprise Architect Consultant and Value Added Reseller
Re: Import of large model from an external source
« Reply #3 on: April 11, 2019, 10:31:25 pm »
I wouldn't try to go through xmi. That really isn't the most easy format to use.

There are a few options:

- Use the excel importer to import classes and attributes. (Excel scales pretty good and goes up to 1M of rows)  You might want to write additional code to import datatypes (and link them to the attributes) and relations.

- Write a custom import program that reads your source database and creates the corresponding model in EA.

I can't image it being more than a few days of work to get it all done.

If you want to hire me as qwerty suggested (thanks qwerty ;)) you can email me at geert@bellekens.com. But please take into account that I have a pretty full calendar already. Next available days at the moment are in July.

Geert

michielper

  • EA User
  • **
  • Posts: 105
  • Karma: +1/-0
    • View Profile
Re: Import of large model from an external source
« Reply #4 on: April 11, 2019, 10:56:47 pm »
I wouldn't try to go through xmi. That really isn't the most easy format to use.

There are a few options:

- Use the excel importer to import classes and attributes. (Excel scales pretty good and goes up to 1M of rows)  You might want to write additional code to import datatypes (and link them to the attributes) and relations.

- Write a custom import program that reads your source database and creates the corresponding model in EA.

I can't image it being more than a few days of work to get it all done.

If you want to hire me as qwerty suggested (thanks qwerty ;)) you can email me at geert@bellekens.com. But please take into account that I have a pretty full calendar already. Next available days at the moment are in July.

Geert

Thanks for these suggestions. This does not sound as a very easy job.

We are in fact investigating the use of EA for the maintenance of a complex model instead of the current text-based interface. The advantage of EA is its graphical representation of the data but getting the data in EA and creating useful diagrams is then a new challenge.

But is EA in itself capable of handling a model with say 200.000 elements and relations?

Geert Bellekens

  • EA Guru
  • *****
  • Posts: 8981
  • Karma: +234/-27
  • Make EA work for YOU!
    • View Profile
    • Enterprise Architect Consultant and Value Added Reseller
Re: Import of large model from an external source
« Reply #5 on: April 12, 2019, 12:39:02 am »
I wouldn't try to go through xmi. That really isn't the most easy format to use.

There are a few options:

- Use the excel importer to import classes and attributes. (Excel scales pretty good and goes up to 1M of rows)  You might want to write additional code to import datatypes (and link them to the attributes) and relations.

- Write a custom import program that reads your source database and creates the corresponding model in EA.

I can't image it being more than a few days of work to get it all done.

If you want to hire me as qwerty suggested (thanks qwerty ;)) you can email me at geert@bellekens.com. But please take into account that I have a pretty full calendar already. Next available days at the moment are in July.

Geert

Thanks for these suggestions. This does not sound as a very easy job.

We are in fact investigating the use of EA for the maintenance of a complex model instead of the current text-based interface. The advantage of EA is its graphical representation of the data but getting the data in EA and creating useful diagrams is then a new challenge.

But is EA in itself capable of handling a model with say 200.000 elements and relations?
Not "very easy" but not that difficult either.
Yes, EA scales pretty well up to hundreds of thousands of elements. (thanks to the database backend)

Geert

michielper

  • EA User
  • **
  • Posts: 105
  • Karma: +1/-0
    • View Profile
Re: Import of large model from an external source
« Reply #6 on: April 12, 2019, 01:03:49 am »
I wouldn't try to go through xmi. That really isn't the most easy format to use.

There are a few options:

- Use the excel importer to import classes and attributes. (Excel scales pretty good and goes up to 1M of rows)  You might want to write additional code to import datatypes (and link them to the attributes) and relations.

- Write a custom import program that reads your source database and creates the corresponding model in EA.

I can't image it being more than a few days of work to get it all done.

If you want to hire me as qwerty suggested (thanks qwerty ;)) you can email me at geert@bellekens.com. But please take into account that I have a pretty full calendar already. Next available days at the moment are in July.

Geert

Thanks for these suggestions. This does not sound as a very easy job.

We are in fact investigating the use of EA for the maintenance of a complex model instead of the current text-based interface. The advantage of EA is its graphical representation of the data but getting the data in EA and creating useful diagrams is then a new challenge.

But is EA in itself capable of handling a model with say 200.000 elements and relations?
Not "very easy" but not that difficult either.
Yes, EA scales pretty well up to hundreds of thousands of elements. (thanks to the database backend)

Geert

Ok, so this might be doable with the XLS-importer? I obtained it from your website but I did not see how it can also import relationships.

Geert Bellekens

  • EA Guru
  • *****
  • Posts: 8981
  • Karma: +234/-27
  • Make EA work for YOU!
    • View Profile
    • Enterprise Architect Consultant and Value Added Reseller
Re: Import of large model from an external source
« Reply #7 on: April 12, 2019, 01:41:05 am »
Ok, so this might be doable with the XLS-importer? I obtained it from your website but I did not see how it can also import relationships.
It can't. As I mentioned it only does elements and attributes. You'll need to write some additional code to link attributes to datatypes, and add relations.

Geert