2021-09-22 Weekly Planning

[mathemancer]

Discussion topics

• Updates: General updates everyone should be aware of.
• Questions: Questions for the team to answer.
• Active Work: Work planned for the next week.
• Retrospective: Summary of last week's work.

About

Each Tuesday, we start a discussion about Mathesar's progress. Everyone is welcome to add a new topic to discuss or to comment on existing topics.

[mathemancer]

Updates

Progress

• 05. Editable Tables is overdue.
• 06. 2021-09 Stability is due 2021-09-23, and will likely be delayed.
• 07. Working with Tables has only frontend issues remaining.
• 08. Initial Data Types has both frontend and backend issues in progress.

We're currently experiencing delays, and will need to reorganize the roadmap once @kgodey returns.

[mathemancer]

Questions

@powellc, @ghislaineguerin, @pavish: Your responses are encouraged. Others are also welcome to respond.

Retrospective

• What went well over the past week?
• What could have gone better over the past week?
• Are there any improvements you'd like to suggest?

Active Work

• Does your workload for this week look okay?
• We have some milestones with timing problems. Are there any suggestions for reprioritizing or reorganizing? (Note that I don't expect to do this till @kgodey returns, but perhaps suggestions could help at that point.)

[pavish]

What went well over the past week?

The issues for Milestone 5 are mostly complete. There is one open PR for adding new records which will be merged soon.

What could have gone better over the past week?

I think the week went well, except that milestone 5 is overdue.

Are there any improvements you'd like to suggest?

None, at the moment.

Does your workload for this week look okay?

The workload for this week is heavy. We will need reorganizing of milestones. I'm hoping to focus mostly on writing detailed tests, setting up integration test environment and to cover all scenarios for features that are complete.

Are there any suggestions for reprioritizing or reorganizing?

None, at the moment.

[ghislaineguerin]

What went well over the past week?

I was making good progress with the UI styling. I managed to have all view-related issues in review state.

What could have gone better over the past week?

I haven't made progress with the reviews. I think Kriti's input is needed.

Are there any improvements you'd like to suggest?

I will change the review dates for the view-related issues to have Kriti as part of the process.

Does your workload for this week look okay?

Yes

We have some milestones with timing problems. Are there any suggestions for reprioritizing or reorganizing? (Note that I don't expect to do this till @kgodey returns, but perhaps suggestions could help at that point.)

None at the time

[mathemancer]

• What went well over the past week?

Things are progressing on type implementations.

• What could have gone better over the past week?

The money types implementation has run into an area where most options seem pretty bad.

• Option 1: too many types (one for each currency, about 300). This means about 90,000 type casting functions, which is a problem.
• Option 2: money currency is a display option. These are not durable, and we could lose them under certain column manipulations
• Option 3: money columns that save the currency in each row. This requires setting the currency on each insert. It's also not supported by the design.
  The text types implementation ran into some bugs around server default setting.

• Are there any improvements you'd like to suggest?

None

• Does your workload for this week look okay?

I need to rework / reorganize. I may have to put type implementation aside while server defaults are handled.

• We have some milestones with timing problems. Are there any suggestions for reprioritizing or reorganizing? (Note that I don't expect to do this till @kgodey returns, but perhaps suggestions could help at that point.)

No suggestions from me.

[mathemancer]

Active Work

This post lists work planned for this week (see also: Active). It also includes a current summary of milestones involved in this week's work.

[2021-09-15] 05. Editable Tables

• 9 issues already closed.
• Issues not yet started:
  • [@pavish] Implement adding new records #197

[2021-09-23] 06. 2021-09 Stability

• 4 issues already closed.
• Issues currently in progress:
  • [@andyharley-cci] Set up staging environment for Mathesar #225
  • [@ghislaineguerin] General styling updates #473
• Issues not yet started:
  • [@kgodey] Refactor db code to work with existing connections #592
  • [@kgodey] Schema sqlalchemy engine caching is per-instance #280
  • [@kgodey] Handle validation, errors, and business logic in the API consistently #623
  • [@kgodey] Set up logging in the backend code #583
  • [@ghislaineguerin] Design for loading, error, and retry states #636
  • [@ghislaineguerin] Review existing UI and create tickets for changes needed #638
  • [@pavish] Set up integration testing environment #639
  • [@pavish] Write integration tests for some important user scenarios #640
  • [@pavish] Unit tests for stores #641
  • [@pavish] Unit tests for all reusable components #642
  • [@pavish] Move filter pane to dropdown #643
  • [@pavish] Frontend unit test cases: Readonly table view #213
• Issues remaining in backlog:
  • 5 backend and database issues
  • 3 frontend issues

[2021-09-28] 07. Working with Tables

• 20 issues already closed.
• Issues currently in progress:
  • [@mr-gabe49] Implement deleting a table #448
  • [@dmos62] Implement showing and changing a column's type #498
  • [@mr-gabe49] Implement deleting a column #496
  • [@mathemancer] IndexError when deleting a column #663
  • [@pegnott] Implement adding a new column #495
• Issues remaining in backlog:
  • 10 frontend issues

[2021-09-30] 2021-09 improvements

• 6 issues already closed.
• Issues currently in progress:
  • [@arvind-1] Column API should support creating columns without names  #555
• Issues remaining in backlog:
  • 1 backend and database issues
  • 11 frontend issues
  • 3 infrastructure issues

[2021-10-05] 08. Initial Data Types

• 30 issues already closed.
• Issues currently in progress:
  • [@mathemancer] Backend work for Mathesar money custom type  #417
  • [@eito-fis] Handle TIME data type in the backend #426
  • [@powellc] Implement filtering options for Number types. #385
  • [@powellc] Handle BOOLEAN data type in the backend #387
  • [@mathemancer] Handle CHAR data type in the backend. #407
  • [@mathemancer] Handle TEXT data type in the backend. #405
  • [@mathemancer] Handle VARCHAR data type in the backend. #404
• Issues not yet started:
  • [@powellc] Implement range based grouping for numeric types. #384
  • [@mathemancer] Create URI custom type and handle it in the backend. #412
  • [@mathemancer] Handle TIMESTAMP data type in the backend #424
  • [@mathemancer] Handle INTERVAL type in the backend #430
  • [@mathemancer] Handle MONEY data type in the backend. #420
  • [@powellc] Implement filtering options for the email type #410
• Issues remaining in backlog:
  • 17 backend and database issues
  • 9 frontend issues
  • 8 product issues

[2021-10-07] 09. Working with Views

• 4 issues already closed.
• Issues currently in progress:
  • [@ghislaineguerin] Support for listing database views #455
  • [@ghislaineguerin] Design for many-to-many relationships between tables  #443
  • [@ghislaineguerin] Support for opening and interacting with a View #466
  • [@ghislaineguerin] Support for deleting a database view #454
  • [@ghislaineguerin] Design for usage of Foreign Key constraints #243
  • [@ghislaineguerin] Support for editing records within a view #456
• Issues remaining in backlog:
  • 7 backend and database issues
  • 2 product issues

[2021-10-18] 11. Multiple Database Support

• 7 issues already closed.
• Issues currently in progress:
  • [@aaditkamat] Backend support for tables without single-column primary keys #395
• Issues remaining in backlog:
  • 3 backend and database issues
  • 3 frontend issues
  • 2 design issues

[mathemancer]

Retrospective

This post lists issue updates from 2021-09-14 until now by milestone.

05. Editable Tables

• Issues closed:
  • [@pavish] Implement record editing #195

06. 2021-09 Stability

• Issues closed:
  • [@pavish] Refactor frontend stores for table-data #651
• Issues started, not yet finished:
  • [@andyharley-cci] Set up staging environment for Mathesar #225
  • [@ghislaineguerin] General styling updates #473
• New issues created:
  • Deleting all columns in a table results in a NoSuchTableError #668, created by @mr-gabe49

07. Working with Tables

• Issues started, not yet finished:
  • [@mr-gabe49] Implement deleting a table #448
  • [@dmos62] Implement showing and changing a column's type #498
  • [@mr-gabe49] Implement deleting a column #496
  • [@mathemancer] IndexError when deleting a column #663
  • [@pegnott] Implement adding a new column #495
• New issues created:
  • IndexError when deleting a column #663, created by @mr-gabe49

2021-09 improvements

• Issues started, not yet finished:
  • [@arvind-1] Column API should support creating columns without names  #555

08. Initial Data Types

• Issues closed:
  • [@ghislaineguerin] Update design for money data type options #655
• Issues started, not yet finished:
  • [@mathemancer] Backend work for Mathesar money custom type  #417
  • [@eito-fis] Handle TIME data type in the backend #426
  • [@powellc] Implement filtering options for Number types. #385
  • [@powellc] Handle BOOLEAN data type in the backend #387
  • [@mathemancer] Handle CHAR data type in the backend. #407
  • [@mathemancer] Handle TEXT data type in the backend. #405
  • [@mathemancer] Handle VARCHAR data type in the backend. #404
• New issues created:
  • Store icon, labels, and input options for types on the backend #661, created by @pavish

09. Working with Views

• Issues started, not yet finished:
  • [@ghislaineguerin] Support for listing database views #455
  • [@ghislaineguerin] Design for many-to-many relationships between tables  #443
  • [@ghislaineguerin] Support for opening and interacting with a View #466
  • [@ghislaineguerin] Support for deleting a database view #454
  • [@ghislaineguerin] Design for usage of Foreign Key constraints #243
  • [@ghislaineguerin] Support for editing records within a view #456

11. Multiple Database Support

• Issues started, not yet finished:
  • [@aaditkamat] Backend support for tables without single-column primary keys #395

2021-10 improvements

• New issues created:
  • Stores are unexpectedly invalidated when subscriber count drops to 0 and goes up to 1 #670, created by @dmos62