Machine Timestamp

[b1gb4dw0lf]

Hello,

I am working on the lab for distributed systems class.
Is there a way to get the machine which became idle the earliest?

Or should I add timestamps to the machines locally or at StageScheduler when DONE message is received? If you suggest the latter, how can I get the machine that sent the DONE message?

Thanks!

[fabianishere]

Hi,

We currently do not explicitly track the timestamp at which a machine becomes idle. However, this feature is easy to implement yourself.

My suggestion would be to track the timestamp at which a machine becomes idle at StageScheduler. You could simply maintain a list of idle machines in the scheduler and update it when a task is scheduled/finished.

To give you a few pointers, here the scheduler identifies finished tasks:

opendc-simulator/opendc-model-odc/core/src/main/kotlin/com/atlarge/opendc/model/odc/platform/scheduler/StageScheduler.kt

Lines 150 to 154 in 3d4ee87

	val correspondingMachine = state.taskMachines[task]
	if (correspondingMachine != null) {
	state.machineCores.merge(correspondingMachine, task.cores, Int::plus)
	state.taskMachines.remove(task)
	}

Here, the scheduler schedules a task on a machine:

opendc-simulator/opendc-model-odc/core/src/main/kotlin/com/atlarge/opendc/model/odc/platform/scheduler/StageScheduler.kt

Lines 188 to 194 in 3d4ee87

	if (machine != null) {
	machine.send(it)
	state.queued.remove(it)
	state.pending.add(it)
	state.taskMachines[it] = machine
	state.machineCores.merge(machine, it.cores, Int::minus)
	}

Hope this helps! Let me know if you have any further questions.

[b1gb4dw0lf]

Thank you for your reply Fabian.
I used your pointers, but instead of using separate lists, I added two fields to Machine State. The value of these two fields are only updated in your pointers in Stage Scheduler. Do you think this solution is ok with the repo?

Also, is there a script to convert parquet format to gwf?

[fabianishere]

That's ok for now. Also, I think we indeed have a script for using traces in Parquet format. I'll come back on this.

[b1gb4dw0lf]

@fabianishere I got the script from Laurens, thanks for the response.