Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CoE Starter Kit - BUG] Inventory data does not get updated after November install #9226

Closed
1 task done
VanIsleCA opened this issue Nov 5, 2024 · 23 comments
Closed
1 task done
Assignees
Labels
bug Something isn't working coe-starter-kit CoE Starter Kit issues

Comments

@VanIsleCA
Copy link

Does this bug already exist in our backlog?

  • I have checked and confirm this is a new bug.

Describe the issue

Hi, I have installed the November release yesterday, and so far, there's no inventory data coming through. I checked some of the Sync flows for Apps, Flows or Audit Logs, and they all run successfully. Also, the installation of the CoE Core has been successful, no red flags.
Any idea what could possibly happen?

Thank you,

Expected Behavior

No response

What solution are you experiencing the issue with?

Core

What solution version are you using?

4.45

What app or flow are you having the issue with?

CoE CORE

What method are you using to get inventory and telemetry?

Cloud flows

Steps To Reproduce

No response

Anything else?

No response

@VanIsleCA VanIsleCA added bug Something isn't working coe-starter-kit CoE Starter Kit issues labels Nov 5, 2024
@Jenefer-Monroe
Copy link
Collaborator

Can you please share a screenshot like this so we can see what solutions you have installed in this environment? Be sure to show all records (all rows) and expand the indicated columns so that we can see full names
image
And also please let us know what region your envt is in as well as its type? This can be found in the product admin pages: https://admin.powerplatform.microsoft.com/
image

Please go to the Admin Command Center > CoE Flows > Inventory. Validate that all flows are turned on and that there are no unmanaged layers as shown here.
image
Then see if there are any sync flow errors to investigate.
image

@VanIsleCA
Copy link
Author

Thanks Jenefer, for your reply,

Please find below screenshots, in the order that you mentioned:

Image
Image
Image
Image

For CoE Inventory flows, no unmanaged layers, and they are all turned on, except the Add Maker which we intentionally leave out with any new update.

Hope this helps,

Look forward to hearing from you,

Thanks.

@VanIsleCA
Copy link
Author

sorry, just realized that images have not been attached in the order that I wanted, but I hope this should still do it.

Thanks,

@Jenefer-Monroe
Copy link
Collaborator

Thank you. Please look for the these Driver flows. Validate that they are turned on, and that they have been running and passing.
Image

@VanIsleCA
Copy link
Author

Thanks, Jenefer,

Here's a screenshot of the Driver flows:
Image
The Escalation one has never run, apparently,

I was checking the Audit logs flows and while they run successfully, they fallback on the NO condition, and I think expected is YES, to populate the Audit Logs, but I might be wrong:
Image

Thanks,

@Jenefer-Monroe
Copy link
Collaborator

Are you saying its just the audit log data that is not populating? I took it to mean all inventory data.
The second one never running is ok, it only runs when needed and it looks like it hasnt been needed. Your driver flow is continuing to run so thats good.

Do you have a specific item that you expect to be in inventory that is not? We can debug with that.

@VanIsleCA
Copy link
Author

VanIsleCA commented Nov 9, 2024

Hi, Jenefer,

It now seems that the inventory for apps, flows, BPFs, Solutions and other artifacts is starting to pick up, so I'd say we should be now good on that, although there was an obvious gap in inventory that we lost.

I would say that Audit Logs is now the only concern. As you can see below, no activity has been recorded since 11/4/, which is the date I upgraded the CoE.

Image

Audit Logs flows have run successful.

Any thoughts? I can provide the csv logs for the flow runs, if it helps. I just need a secure way to upload that,

Thank you,

@Jenefer-Monroe
Copy link
Collaborator

Missing data

Although there was an obvious gap in inventory that we lost.

Can you clarify what you mean here? Are you missing (for example) apps created / edited during some period of time?

Audit Logs

  1. Which api are you using for the audit log?
  1. Are you storing your app registration in Azure Key Vault? Or as plain text.
  2. Are both these flows turned on, running, and passing?
    Image

@VanIsleCA
Copy link
Author

Hi, Jenefer,

Please see my responses below:

Missing data
Can you clarify what you mean here? Are you missing (for example) apps created / edited during some period of time?

I have checked again by comparing with a "working" COE instance and it seems that I was wrong - inventory data is not missing, except for the Audit Logs (see below).

Audit Logs

  1. Which api are you using for the audit log?
    Office 365 Management API, the way I know it. How can I check?

  2. Are you storing your app registration in Azure Key Vault? Or as plain text.
    Plain text

  3. Are both these flows turned on, running, and passing?
    Both flows running an passing, as shown below, BUT, the Update Data flow's last run was November 4th, which is the date we updated the COE and also the day we stopped getting any more logs in the Audit Log table.
    Image

Your insight is appreciated. Thanks,

@Jenefer-Monroe
Copy link
Collaborator

App Registration
Can you please share a screenshot of your App Registrations API Permissions?
image

And can you validate that these env vars are all set now including ones like Audience?
image

@VanIsleCA
Copy link
Author

Sure,

API Permissions:
Image

Audit Logs env variables:
Image

@Jenefer-Monroe
Copy link
Collaborator

Can you please let us know what region your envt is in as well as its type? This can be found in the product admin pages: https://admin.powerplatform.microsoft.com/
image

@VanIsleCA
Copy link
Author

Hi, Jenefer,

Please see below:

Image

Thanks,

@Jenefer-Monroe
Copy link
Collaborator

What volume of app launches are you used to seeing in a typical hour?

If "plenty" then lets just go open the flow and see what's happening. If not then go boot some and wait 10-15 minutes before doing the below.

Open the most recent run of Admin | Audit Logs | Sync Audit Logs (V2)
Is this call passing?
Image

Move through this loop until you find something returned in the filter event call
Image

@VanIsleCA
Copy link
Author

Hi, Jenefer,

We typically get a volume of about 30-50 app launches a day, for this particular COE instance.
I did launch a few apps and waited 10-15 min as suggested. And then checked the Admin | Audit Logs | Sync Audit Logs (V2) flow run. Here are the details:

Run is successfully passing the ListAuditLogContent call:
Image

As for the FilterEvents, I have iterated through the items and all of them return an EMPTY Output:

Image

Hope this helps,

Thanks again for looking at this,

@Jenefer-Monroe
Copy link
Collaborator

I presume you looked through all 54 yes? Is there data in the ParseEvents above that?
Image

@VanIsleCA
Copy link
Author

Hi, Jenefer,

Ies, I did look through ALL 54!. And yes, ParseEvents does have inputs/outputs with every iteration. I was even able to locate one of my LaunchApp test events:

Image

@Jenefer-Monroe
Copy link
Collaborator

Jenefer-Monroe commented Nov 16, 2024

ok this (record type = 45) is the issue
Image

Unfortunately it looks like they did not roll out the Purview change to all tenants for some reason.
I made a workaround solution for you. You will need to import it and use the flow in their instead until your tenant gets the new API schema
Please see #9268

@VanIsleCA
Copy link
Author

oh, wow, that's appreciated!

will do and let you know,

have a wonderful weekend,

@VanIsleCA
Copy link
Author

Success! Audit logs are now coming through, thanks so much for your support with this,

Regards,

@Jenefer-Monroe
Copy link
Collaborator

sorry it took us so many back and forths to get settled into the issue, and thanks for helping me debug.

@VanIsleCA
Copy link
Author

No worries, it was good learning, after all.

Thanks,

@Jenefer-Monroe
Copy link
Collaborator

closing out as no further action for starter kit team

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working coe-starter-kit CoE Starter Kit issues
Projects
Status: Done
Development

No branches or pull requests

2 participants