Welcome to butler-spyglass Discussions!

[mountaindude]

👋 Welcome!

We’re using Discussions as a place to connect with other members of our community. We hope that you:

• Ask questions you’re wondering about.
• Share ideas.
• Engage with other community members.
• Welcome others and are open-minded. Remember that this is a community we
  build together 💪.

To get started, comment below with an introduction of yourself and tell us about what you do with this community.

[dilipqv]

Hi Team,

I'm trying to configure but facing below error can you please help.

D:\tools\butler-spyglass-master\butler-spyglass-master>node butler-spyglass.js
2025-01-12T08:06:53.414Z info: --------------------------------------
2025-01-12T08:06:53.416Z info: | butler-spyglass
2025-01-12T08:06:53.417Z info: |
2025-01-12T08:06:53.417Z info: | Version : 2.1.0
2025-01-12T08:06:53.418Z info: | Log level : info
2025-01-12T08:06:53.418Z info: |
2025-01-12T08:06:53.418Z info: --------------------------------------
2025-01-12T08:06:53.419Z info:
2025-01-12T08:06:53.419Z info: Extracting metadata from server: 10.69.122.98
2025-01-12T08:06:53.419Z info: Data linage files will be stored in : ./out/lineage
2025-01-12T08:06:53.420Z info: Load script files will be stored in : ./out/script
2025-01-12T08:06:53.420Z info: Data connection definitions files will be stored in: ./out/dataconnection
2025-01-12T08:06:53.423Z info: --------------------------------------
2025-01-12T08:06:53.423Z info: Extraction run started
2025-01-12T08:06:53.488Z info: Got 168359 data connections from QRS
2025-01-12T08:06:53.489Z error: DATA CONNECTION: Error while getting data connections: {}
node:internal/process/promises:279
triggerUncaughtException(err, true /* fromPromise */);
^

[UnhandledPromiseRejection: This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). The promise rejected with the reason "Error while getting data connections".] {
code: 'ERR_UNHANDLED_REJECTION'
}

[mountaindude]

Hi @dilipqv,

That looks like a bug, or at least poor design within the Butler Spyglass tool.
Unfortunately I have not had time/reason to spend much time on this tool lately, last release was well over a year ago (almost two actually..).

That said, the tool did work well back then for the use cases I and others had.
Could be that the bug you experience is related to the VERY large number of data connections you seem to have...
Is that number accurate? That's pretty interesting if so, from a scalability perspective. Would love to dig into that kind of Sense environment from a stability and monitoring perspective! :)

As for fixing the issue in Butler Spyglass I don't have much bandwidth the coming weeks/month, lots of other work ongoing in the near future.
Things may open up towards end of March, so if you need help then/later I'd be happy to chat.