Skip to content

Conversation

@matthewrmshin
Copy link
Collaborator

Description

Dump without aliases, i.e., expand out references. Option to dump without root level sub-object underscore.

Issue(s) addressed

Resolves #41.

Checklist

  • I have performed a self-review of my own code
  • I have made corresponding changes to the documentation
  • I have run the unit tests before creating the PR

@matthewrmshin matthewrmshin added this to the next-release milestone Jul 22, 2025
@matthewrmshin matthewrmshin self-assigned this Jul 22, 2025
Dump without aliases, i.e., expand out references.
Option to dump without root level sub-object underscore.
@matthewrmshin matthewrmshin force-pushed the feature/dump-no-aliases-no-underscore branch from 4775f0c to 5ef1d72 Compare July 22, 2025 15:16
Copy link
Collaborator

@steoxley steoxley left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. One typo. Note, I haven't tested, and trust your self review declaration is accurate.

Co-authored-by: Stephen Oxley <stephen.oxley@metoffice.gov.uk>
Copy link
Collaborator

@steoxley steoxley left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

Copy link
Contributor

@mikecooke77 mikecooke77 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This all looks good and I've tested it locally on an offline file. It would be useful to test as part of malak. Could a version of this be installed somewhere on the exa and I can then point malak at that instead of the one in the stack?

yaml.dump(data, infile)
outfilename = tmp_path / 'b.yaml'
main([str(infilename), str(outfilename)])
main([str(infilename), '-o', str(outfilename)])
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this a change in behaviour or are you just being explicit?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is introduced in a previous change and is nicer CLI usage (as multiple arguments can now be used to concat files). So being explicit here.

@matthewrmshin
Copy link
Collaborator Author

I'll look to how to install something on the HPC. (Not straightforward as yamlprocessor is installed as a Python package in the stack. I can build a local stack+main in my environment to test with malak.)

@matthewrmshin
Copy link
Collaborator Author

@mikecooke77 Can use this build on exab (excd one still building):

source ~matthew.shin/cylc-run/mobbms-d/yp066a1/share/default/mobb-env.sh

Or start up malak with cylc play -S 'JEDI_BUILD="~matthew.shin/cylc-run/mobbms-d/yp066a1"' ....

Copy link
Contributor

@mikecooke77 mikecooke77 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can confirm this is behaving as expected when comparing the output to the overnight testing. I have run two of the kgos to check no issue and all looks good see here:
malak kgo_glu_jopa_jada
sith kgo_glu
This is a really helpful improvement as it will allow us to separate out the kgo and operational observation settings for jada and jopa. We can also rationalise the jada yamls to just gl rather than glm and glu specific ones.

@mikecooke77
Copy link
Contributor

malak kgo_glu_jopa_jada

Note the failure in the above is because I had var highres switched on which differs from the kgo run normally. This can be ignored.

@matthewrmshin matthewrmshin merged commit 94fcedc into develop Jul 24, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Clearing lists and removing _:

4 participants