Sasdata database redux - #213

Merged

krzywon merged 967 commits into

refactor_24from

sasdata-database-merged

Jul 27, 2026

This pull request is big! We're only showing the most recent 250 commits

Commits on Jun 3, 2026

Change permissions handling for download

summerhenson
authored and
krzywon
committed
cdc707a
Return bad request for non put or push upload

summerhenson
authored and
krzywon
committed
e69f66c
Add tests for accessing nonexistent data

summerhenson
authored and
krzywon
committed
e56304a
Comment out unfinished test line

summerhenson
authored and
krzywon
committed
e3bf9e3
Read download files to ensure they close - attempt to fix unit test failures on windows

summerhenson
authored and
krzywon
committed
cdb492d
Fix typo

summerhenson
authored and
krzywon
committed
e466b51
Preliminary documentation for models

summerhenson
authored and
krzywon
committed
62d033a
Base abstract model for user and is_public

summerhenson
authored and
krzywon
committed
4cf82d5
Enable list other users' public data

summerhenson
authored and
krzywon
committed
f6662ac
404 for list by nonexistent username

summerhenson
authored and
krzywon
committed
dfdeb66
Switch to filter by username param not request user

summerhenson
authored and
krzywon
committed
2f0ed8c
Change permissions tests to expected user list behavior

summerhenson
authored and
krzywon
committed
01f7dae
Change data tests to expected user list behavior

summerhenson
authored and
krzywon
committed
920d2ea
Create initial version of dataset model

summerhenson
authored and
krzywon
committed
f863436
Start OperationTree model

summerhenson
authored and
krzywon
committed
898ccb6
Start Session model

summerhenson
authored and
krzywon
committed
f2f6b4e
Begin SasData serializers

summerhenson
authored and
krzywon
committed
fbf9cca
Start of Quantity serializer

summerhenson
authored and
krzywon
committed
7291d8b
Serializer for NamedQuantity

summerhenson
authored and
krzywon
committed
8ca8a3d
Continue SasData serializer and add notes

summerhenson
authored and
krzywon
committed
16706f7
Add class for MetaData model

summerhenson
authored and
krzywon
committed
5f3998d
Temporarily comment out unmigrated models

summerhenson
authored and
krzywon
committed
411486b
Serializers for units

summerhenson
authored and
krzywon
committed
c899c5c
QuantityHistory serializer

summerhenson
authored and
krzywon
committed
bc2a134
Serializers for Dataset and Group

summerhenson
authored and
krzywon
committed
13f123f
Framework for metadata serializers

summerhenson
authored and
krzywon
committed
643dde5
Instrument metadata serializers

summerhenson
authored and
krzywon
committed
dafc9d5
Finish metadata serializers

summerhenson
authored and
krzywon
committed
8415bb5
Updates to in-progess data models

summerhenson
authored and
krzywon
committed
abd26bc
Initial versions of phase 1 models

summerhenson
authored and
krzywon
committed
a6442e8
model migrations

summerhenson
authored and
krzywon
committed
af2844d
Add field for authorized non-owners for data

summerhenson
authored and
krzywon
committed
244c74f
Change permissions to check users with access instead of just ownership

summerhenson
authored and
krzywon
committed
f6f5df1
Ensure owner can access data

summerhenson
authored and
krzywon
committed
58bde89
Bare bones serializers for database models

summerhenson
authored and
krzywon
committed
4b242e7
Switch serialization methods to non-protected so pycharm stops nagging me

summerhenson
authored and
krzywon
committed
6707b32
Deserialization for SasData class

summerhenson
authored and
krzywon
committed
aa3e34f
Deserialization for Group and Dataset classes

summerhenson
authored and
krzywon
committed
917f3ce
Deserialization for Quantity classes

summerhenson
authored and
krzywon
committed
c32b444
Add functionality to give and remove access to a file

summerhenson
authored and
krzywon
committed
f1bdbf8
Add response to access management view

summerhenson
authored and
krzywon
committed
cb26589
Tests for access granting/removal

summerhenson
authored and
krzywon
committed
2af9eaa
Fix errors in access management view

summerhenson
authored and
krzywon
committed
f43fabe
More tests for access management

summerhenson
authored and
krzywon
committed
df68e09
Remove redundant code in permissions

summerhenson
authored and
krzywon
committed
6149c79
QuantityType serialisation for some types

summerhenson
authored and
krzywon
committed
b89bdb8
Allow viewing who has access to a file

summerhenson
authored and
krzywon
committed
0d7ec28
Test listing users with access to a file

summerhenson
authored and
krzywon
committed
0f450b4
Test permissions on file access management views

summerhenson
authored and
krzywon
committed
e8433ef
Serialize variance not standard deviation

summerhenson
authored and
krzywon
committed
156c82c
Finish models pending later changes

summerhenson
authored and
krzywon
committed
0c1b9fe
Add to documentation on future ORCID integration

summerhenson
authored and
krzywon
committed
9308f31
Change data creation status code to 201

summerhenson
authored and
krzywon
committed
3987cd1
Modify tests to run faster

summerhenson
authored and
krzywon
committed
de9abf8
Change authentication tests to run faster

summerhenson
authored and
krzywon
committed
da7ba9e
Speed up data tests

summerhenson
authored and
krzywon
committed
bd56f03
One more attempt to speed up user_app tests

summerhenson
authored and
krzywon
committed
ee6e4e1
Create view to delete a file

summerhenson
authored and
krzywon
committed
485f71d
Tests for file delete

summerhenson
authored and
krzywon
committed
ccf8368
Reorganize data tests

summerhenson
authored and
krzywon
committed
0ba8cc9
Start planning tests for dataset

summerhenson
authored and
krzywon
committed
457f0ce
Initial version of DataSetView

summerhenson
authored and
krzywon
committed
450cdd6
General structure of dataset views

summerhenson
authored and
krzywon
committed
55efe12
Updated version of DataSetView pending serialization changes

summerhenson
authored and
krzywon
committed
05a3ceb
First draft of SingleDataSetView

summerhenson
authored and
krzywon
committed
8f10e97
First draft for DataSetUsersView

summerhenson
authored and
krzywon
committed
5c6c24a
Add filter based on username in get request body

summerhenson
authored and
krzywon
committed
6eee3df
Nested metadata serialization

summerhenson
authored and
krzywon
committed
fcf4a7c
Fix error in paths

summerhenson
authored and
krzywon
committed
47cbd8d
Structure for dataset tests

summerhenson
authored and
krzywon
committed
5fdd051
Fix filtering by username

summerhenson
authored and
krzywon
committed
390e68d
Tests for listing datasets

summerhenson
authored and
krzywon
committed
b1b7678
Tests for loading a dataset

summerhenson
authored and
krzywon
committed
7bd43c6
Test for deleting a dataset

summerhenson
authored and
krzywon
committed
51b8d0f
Fix error in permissions check

summerhenson
authored and
krzywon
committed
4b0e5d0
Tests for updating a dataset

summerhenson
authored and
krzywon
committed
bd9fcee
Only allow data owner to view/manage access

summerhenson
authored and
krzywon
committed
c8826cb
Tests for listing users with access to a dataset

summerhenson
authored and
krzywon
committed
eee6f0d
Test granting access to dataset

summerhenson
authored and
krzywon
committed
7ec9592
Fix dataset creation

summerhenson
authored and
krzywon
committed
5c88067
Set owner when data is created

summerhenson
authored and
krzywon
committed
1cbf256
Disallow creating private data without an owner

summerhenson
authored and
krzywon
committed
af98488
Finish tests for DataSetView

summerhenson
authored and
krzywon
committed
5736653
Fix error in accessing request user from serializer

summerhenson
authored and
krzywon
committed
2387679
Modify existing SingleDataSet tests

summerhenson
authored and
krzywon
committed
b0e8ff0
Tests for unauthorized deletes

summerhenson
authored and
krzywon
committed
65a156d
Finish DataSetAccessManagement tests

summerhenson
authored and
krzywon
committed
b275cf1
Allow private data owner to change, not just public

summerhenson
authored and
krzywon
committed
832dac1
Document dataset tests + one more test

summerhenson
authored and
krzywon
committed
ac3079f
Documentation for datafile tests

summerhenson
authored and
krzywon
committed
1fc96de
Tests to make sure a user can't specify a data object id

summerhenson
authored and
krzywon
committed
189c216
Add operation/parameters fields to OperationTree model

summerhenson
authored and
krzywon
committed
253393e
Change response status to 401 for unauthenticated

summerhenson
authored and
krzywon
committed
711cb7a
Change tests to reflect status code change

summerhenson
authored and
krzywon
committed
8c16660
Skeleton of reformatted data file API

summerhenson
authored and
krzywon
committed
f326cc1
Fill out DataFileView methods

summerhenson
authored and
krzywon
committed
1f584e1
Change serializer validation to raise exception

summerhenson
authored and
krzywon
committed
3b863b9
SingleDataFileView methods

summerhenson
authored and
krzywon
committed
54ba8f2
DataFileUsersView methods

summerhenson
authored and
krzywon
committed
21b4f29
Update urls for DataFile

summerhenson
authored and
krzywon
committed
d800735
Fix error in get method for file download

summerhenson
authored and
krzywon
committed
8b7f771
Fix error in datafile post

summerhenson
authored and
krzywon
committed
080456e
Update tests for url changes

summerhenson
authored and
krzywon
committed
8128355
Updates for changes to SasData class

summerhenson
authored and
krzywon
committed
f8c57cf
Add published state to session model

summerhenson
authored and
krzywon
committed
b5b6566
Update metadata serializers for latest changes

summerhenson
authored and
krzywon
committed
3cd9e59
Update metadata model for recent changes

summerhenson
authored and
krzywon
committed
44f04b5
Account for metadata changes in test

summerhenson
authored and
krzywon
committed
3269b76
Changes to OperationTree model

summerhenson
authored and
krzywon
committed
22235fd
Change metadata serialization in SasData serialization method

summerhenson
authored and
krzywon
committed
d65e5af
Change defaults and designate allowed operations for metadata/operations models

summerhenson
authored and
krzywon
committed
93d940f
Customize creation in OperationTreeSerializer

summerhenson
authored and
krzywon
committed
e165a6d
Quantity model

summerhenson
authored and
krzywon
committed
319269d
Change SasData serializer to facilitate database deserialization

summerhenson
authored and
krzywon
committed
9748c12
Nested quantity serialization in DataSetSerializer

summerhenson
authored and
krzywon
committed
11ca9a7
Add nested quantities to tests

summerhenson
authored and
krzywon
committed
6c619ca
Comment out failing sasdata tests until they get fixed

summerhenson
authored and
krzywon
committed
326760c
Edits to github actions/yml files

summerhenson
authored and
krzywon
committed
e6125d0
Clarify logic in permissions

summerhenson
authored and
krzywon
committed
0af7d7b
Test tokens valid on multiple login

summerhenson
authored and
krzywon
committed
8e04f09
Remove mysterious extra spaces

summerhenson
authored and
krzywon
committed
7e9f367
Change operations model to refer to quantity

summerhenson
authored and
krzywon
committed
b88437b
Add nested serialization for operation tree in quantity

summerhenson
authored and
krzywon
committed
bc8e54c
Make operations tree optional for a quantity

summerhenson
authored and
krzywon
committed
00e5246
Rename api clients in tests for clarity

summerhenson
authored and
krzywon
committed
f0fbca3
Restrict Django test runner to database tests

summerhenson
authored and
krzywon
committed
4603bf4
String representation of units for serialization

summerhenson
authored and
krzywon
committed
d6eeeac
Change and test response for changing access to a DataFile

summerhenson
authored and
krzywon
committed
5877827
Add hash value to quantity serialization

summerhenson
authored and
krzywon
committed
dd6ae8b
Delete old method-based views

summerhenson
authored and
krzywon
committed
fbe04e0
Change and test response for DataSet access management

summerhenson
authored and
krzywon
committed
e12b789
Serialization for QuantityType

summerhenson
authored and
krzywon
committed
d2a5bf8
Empty class for operation testing

summerhenson
authored and
krzywon
committed
d875813
PublishedState and Session models

summerhenson
authored and
krzywon
committed
0c36841
Empty classes for session views

summerhenson
authored and
krzywon
committed
e673116
Basic serializer for session

summerhenson
authored and
krzywon
committed
fb4be4e
Nested serializers in SessionSerializer

summerhenson
authored and
krzywon
committed
8e33187
session post method

summerhenson
authored and
krzywon
committed
0f9e4f7
Session access management views

summerhenson
authored and
krzywon
committed
9027991
urls for sessions

summerhenson
authored and
krzywon
committed
bca9d5e
methods for SingleSessionView - might need to revise later

summerhenson
authored and
krzywon
committed
545e17c
Switch key from OperationTree to Quantity

summerhenson
authored and
krzywon
committed
1728648
Add nested OperationTree to Quantity serializer

summerhenson
authored and
krzywon
committed
ad108da
Add title to Session

summerhenson
authored and
krzywon
committed
5e7e8c8
Use numerical_encoding in sasdata for QuantityType serialization/deserialization

summerhenson
authored and
krzywon
committed
4d344ba
Change some comments in models

summerhenson
authored and
krzywon
committed
9aaa583
Fix some bugs in operation tree deserialization

summerhenson
authored and
krzywon
committed
a5591ee
Test creation of operation trees

summerhenson
authored and
krzywon
committed
3f3d8e7
Test creating a quantity with no operations performed on it

summerhenson
authored and
krzywon
committed
98e89f8
Test creating an operation tree with an invalid operation

summerhenson
authored and
krzywon
committed
e4493ef
Store quantity label as part of quantity

summerhenson
authored and
krzywon
committed
d354c50
Customize OperationTree serialization from database representation

summerhenson
authored and
krzywon
committed
c09bd4b
Test GET with unary operation

summerhenson
authored and
krzywon
committed
5cfa223
More tests for GET with operation trees

summerhenson
authored and
krzywon
committed
1a48b71
Fix minor bug in OperationTree tests

summerhenson
authored and
krzywon
committed
41d9b18
Comments and planning for OperationTree testing

summerhenson
authored and
krzywon
committed
bde881f
Reorganize OperationTree tests and move to dedicated file

summerhenson
authored and
krzywon
committed
d5b11da
Tests for tensor product operation

summerhenson
authored and
krzywon
committed
71cb994
Validate nested operations and check parameters based on type

summerhenson
authored and
krzywon
committed
1889498
Test creating invalid non-top-level operation fails

summerhenson
authored and
krzywon
committed
9c8485d
Separate class for invalid operation tree testing

summerhenson
authored and
krzywon
committed
5641b34
Check operation trees only in operation tree get tests

summerhenson
authored and
krzywon
committed
afcc0a5
Test creating operations with missing parameters fails

summerhenson
authored and
krzywon
committed
3272253
Test creating a quantity with no history

summerhenson
authored and
krzywon
committed
d37c38f
Check whether deleting a dataset deletes its quantities (it doesn't) (this is kind of a problem)

summerhenson
authored and
krzywon
committed
a21e1ae
Test whether deleting a dataset/its quantities deletes operations (it doesn't do this either)

summerhenson
authored and
krzywon
committed
13ea044
Try switching from many-to-many to one-to-many relationship for DataSet and Quantity

summerhenson
authored and
krzywon
committed
cd626bb
Change operations test setup to account for altered model relationship

summerhenson
authored and
krzywon
committed
015ae99
Remove dataset id from serialized quantity

summerhenson
authored and
krzywon
committed
5e6b1ef
Prevent deleting parent operations instead of cascading

summerhenson
authored and
krzywon
committed
c6d8d67
Automatically delete OperationTrees when quantities are deleted

summerhenson
authored and
krzywon
committed
a9d7d6c
Test nested OperationTree instances are deleted

summerhenson
authored and
krzywon
committed
02c44be
Change direction of DataSet/MetaData relationship for automatic deletion

summerhenson
authored and
krzywon
committed
47d8006
Change direction of Quantity/OperationTree relationship for automatic deletion

summerhenson
authored and
krzywon
committed
8605d8f
Change direction of Session/DataSet relationship for automatic deletion

summerhenson
authored and
krzywon
committed
1a4c28e
Change direction of Session/PublishedState relationship for automatic deletion

summerhenson
authored and
krzywon
committed
542d489
Change direction of OperationTree parent-child links for automatic delete

summerhenson
authored and
krzywon
committed
b174b3f
Serializer for session

summerhenson
authored and
krzywon
committed
2718c4b
Get method for Sessions

summerhenson
authored and
krzywon
committed
ab5ad16
Return is_public in access management GET requests

summerhenson
authored and
krzywon
committed
3fd6091
Remove dataset id from MetaData instance serialization

summerhenson
authored and
krzywon
committed
1ea1c9e
Test GET dataset with metadata

summerhenson
authored and
krzywon
committed
9d1a925
Add comments to serializer classes

summerhenson
authored and
krzywon
committed
5569a32
Fix serialization of DataSet with files

summerhenson
authored and
krzywon
committed
afb2a3b
Check access to files in a dataset

summerhenson
authored and
krzywon
committed
b695602
Test DataSet creation with files

summerhenson
authored and
krzywon
committed
0b6a5e4
Filter files in dataset by access

summerhenson
authored and
krzywon
committed
5964cdf
Test loading dataset with files

summerhenson
authored and
krzywon
committed
5730ec9
Start session tests

summerhenson
authored and
krzywon
committed
2e5b3e1
Copy session is_public value to composing datasets

summerhenson
authored and
krzywon
committed
281bd45
Test listing sessions

summerhenson
authored and
krzywon
committed
75c64fb
Fix bugs in DataSet creation nested in a Session

summerhenson
authored and
krzywon
committed
3d24ec1
Include username and authentication status in all post responses

summerhenson
authored and
krzywon
committed
954ec48
Disallow creating private sessions without an owner

summerhenson
authored and
krzywon
committed
9244550
Test Session post method

summerhenson
authored and
krzywon
committed
58cbc1a
Use the right serializer for sessions and return id with get

summerhenson
authored and
krzywon
committed
0789f1b
Test get method for individual sessions

summerhenson
authored and
krzywon
committed
0cfa6ea
Test put method for individual sessions

summerhenson
authored and
krzywon
committed
a1a4a67
Test Session delete method

summerhenson
authored and
krzywon
committed
7f5a6e3
Propagate access changes from session to composing datasets

summerhenson
authored and
krzywon
committed
62a7b2c
Test Session access management

summerhenson
authored and
krzywon
committed
b29913c
Return current_user as username not id

summerhenson
authored and
krzywon
committed
66d4e78
Comments of session testing

summerhenson
authored and
krzywon
committed
756cf59
Add field for history references to Quantity

summerhenson
authored and
krzywon
committed
ccbb2ae
Serialization for Quantity variable references

summerhenson
authored and
krzywon
committed
6a63374
Change serialization of QuantityHistory references to match API

summerhenson
authored and
krzywon
committed
3ee37ab
Serialize Quantity operation_tree and references as history

summerhenson
authored and
krzywon
committed
bfdaad3
Remove infinite serialization loop of quantities and histories

summerhenson
authored and
krzywon
committed
5bae9a1
Separate model for history reference quantities

summerhenson
authored and
krzywon
committed
c6eaecc
Test references in quantity history

summerhenson
authored and
krzywon
committed
7860fd5
Add tests to test updating a DataSet

summerhenson
authored and
krzywon
committed
66be25a
Propagate update to session is_public to datasets

summerhenson
authored and
krzywon
committed
9569b17
PublishedState serialization and minor serializer create method simplifications

summerhenson
authored and
krzywon
committed
8223a4a
Outline of PublishedState views

summerhenson
authored and
krzywon
committed
d406a43
PublishedState list method

summerhenson
authored and
krzywon
committed
cb8447c
Serializer to restrict PublishedState update to published field

summerhenson
authored and
krzywon
committed
dd8e493
Post method for PublishedState

summerhenson
authored and
krzywon
committed
db6de1f
Get method for single PublishedState

summerhenson
authored and
krzywon
committed
fef2ef1
Update method for PublishedState

summerhenson
authored and
krzywon
committed
75da757
Delete method for PublishedState

summerhenson
authored and
krzywon
committed
8e3407e
Planning for PublishedState testing

summerhenson
authored and
krzywon
committed
54ad406
PublishedState urls

summerhenson
authored and
krzywon
committed
f84cd11
Test listing published states

summerhenson
authored and
krzywon
committed
c104d0a
Fix bugs in PublishedState creation

summerhenson
authored and
krzywon
committed
b8b71bb
Check that session doesn't already have a published state

summerhenson
authored and
krzywon
committed
9cc8ef0
Test creating a published state

summerhenson
authored and
krzywon
committed
fec53f6
Add fields to PublishedState get response

summerhenson
authored and
krzywon
committed
aae2793
Test individual PublishedState get method

summerhenson
authored and
krzywon
committed
3b90189
Test PublishedState update method

summerhenson
authored and
krzywon
committed
2a648f4
Test PublishedState delete method

summerhenson
authored and
krzywon
committed
517c889
Session creation example script

summerhenson
authored and
krzywon
committed
ec735ca
Add models to admin interface

summerhenson
authored and
krzywon
committed
24cacd6
Account for json strings in post requests

summerhenson
authored and
krzywon
committed
a56c55e
Enable session-based authentication

summerhenson
authored and
krzywon
committed
dfc415a
Comments for PublishedState tests

summerhenson
authored and
krzywon
committed
bf9b3bf
Test that metadata is required for dataset creation

summerhenson
authored and
krzywon
committed
b06e244
Minor changes suggested by Jeff

summerhenson
authored and
krzywon
committed
dc84d8d
Nested PublishedState update in Session

summerhenson
authored and
krzywon
committed
8b03812
Test nested PublishedState

summerhenson
authored and
krzywon
committed
3f314b3
Test listing published states by username

summerhenson
authored and
krzywon
committed
e0c810f
Deserialization methods for sasdata structures

summerhenson
authored and
krzywon
committed
b0a8a0d
ruff formatting changes
krzywon
committed
11b203d
merge refactor_24 into sasdata-database-cherry-pick-merge and resolve conflicts
krzywon
committed
38ebaad
ruff fixes
krzywon
committed
58f703e
ruff fixes
krzywon
committed
a933ba2
merge refactor_24 into sasdata-database-merge and resolve conflicts
krzywon
committed
4e9db5a

Commits on Jun 4, 2026

Commits on Jul 24, 2026

Merge refactor_24 into sasdata-database-merged and resolve conflicts
krzywon
committed
ed77cda

Uh oh!

Commits

Commits on Jun 3, 2026