[{"_1":2,"_203":-5,"_204":-5},"loaderData",{"_3":4,"_13":14,"_21":22,"_175":176},"root",{"_5":-5,"_6":-7,"_7":8,"_9":-7,"_10":11,"_12":-7},"currentUser","primaryEmail","siteVerification","6LeIxAcTAAAAAJcZVRqyHh71UMIEGNQ_MXjiZKhI","toast","enableDev",false,"incidentStatus","routes/_layout",{"_15":-5,"_16":17,"_18":17,"_19":11,"_20":11},"username","isAskGordonEnabled",true,"isUsingNewTemplate","showMinimalLanding","showHoneypotTrap","routes/_layout.r.$namespace.$reponame",{"_23":24,"_25":-5,"_26":11,"_27":11,"_28":29,"_30":31,"_32":-5,"_33":11,"_34":35,"_86":87,"_110":111,"_168":-5,"_169":11,"_170":17,"_171":11,"_172":-5,"_173":174},"canonicalUrl","https://hub.docker.com/r/dbhi/scds/tags","mcpServer","canSeeDockerfile","canSeeAutobuilds","namespace","dbhi","reponame","scds","cloudBuildSource","isAutobuildsAvailable","repo",{"_36":37,"_38":39,"_42":43,"_44":45,"_46":11,"_47":48,"_49":50,"_51":52,"_55":31,"_28":29,"_56":57,"_58":-5,"_59":60,"_61":62,"_63":64,"_65":-5,"_66":60,"_67":68,"_69":11,"_70":29,"_71":72,"_77":17,"_78":79,"_83":29,"_84":85},"categories",[],"content_types",[40,41],"unrecognized","image","date_registered","2015-07-15T12:04:52.713525Z","description","","is_private","last_updated","2016-09-20T17:19:57.943679Z","last_modified","2024-10-16T13:48:34.145251Z","media_types",[53,54],"application/octet-stream","application/vnd.docker.container.image.v1+json","name","pull_count",570,"repository_type","star_count",0,"status",1,"status_description","active","source","collaborator_count","full_description","# Slowly-Changing Dimension Store (SCDS)\n\n[![Build Status](https://travis-ci.org/chop-dbhi/scds.svg?branch=master)](https://travis-ci.org/chop-dbhi/scds) [![Coverage Status](https://coveralls.io/repos/chop-dbhi/scds/badge.svg?branch=master&service=github)](https://coveralls.io/github/chop-dbhi/scds?branch=master) [![GoDoc](https://godoc.org/github.com/chop-dbhi/scds?status.svg)](https://godoc.org/github.com/chop-dbhi/scds)\n\nSCDS is designed to answer a single question, \"has this data changed since the last time I saw it?\" The motivation stems from working on data integration pipelines where it may be unknown when or how downstream data has changed. There are two basic use cases:\n\n- Check the data to fail quickly or apply other logic.\n- Put the data each time it is seen to see how it changes over time.\n\n*Note: albeit functional, this is a prototype implementation for solving this problem.*\n\n## Usage\n\nThere are two interfaces supported, command line and HTTP. They share the same set of operations and work with JSON-encoded data.\n\n### Operations\n\n#### `put`\n\nPut an object in the store where `value` is a valid JSON document. Putting the same object consecutively will not result in duplicate changes.\n\n```\nput \n```\n\n#### `get`\n\nGet the current state of the object. Use the `-version` or `-time` option to get a particular revision.\n\n```\nget \n```\n\n#### `keys`\n\nGets a list of keys in the store.\n\n```\nkeys\n```\n\n#### `log`\n\nGet the log of changes for an object.\n\n```\nlog \n```\n\n#### `config`\n\nPrints the configuration options used.\n\n```\nconfig\n```\n\n#### `subscribe`\n\nSubscribes one or more email addresses for notifications.\n\n```\nsubscribe email [emails...]\n```\n\n#### `unsubscribe`\n\nUnsubscribes one or more email addresses from notifications.\n\n```\nunsubscribe email [emails...]\n```\n\n### CLI\n\nSee `scds help` for more information.\n\nInline JSON.\n\n```bash\nscds put bob '{\"name\": \"Bob\"}'\n```\n\n```json\n{\n \"Version\": 1,\n \"Time\": 1436960622,\n \"Additions\": {\n \"name\": \"Bob\"\n },\n \"Removals\": null,\n \"Changes\": null\n}\n```\n\nAlternately, if not `value` is supplied, data will be read from stdin.\n\n```bash\nscds put hello < hello.json\n```\n\nRunning the above command again will return nothing since nothing changed. However if we change it a new revision will be created.\n\n```bash\nscds put bob '{\"name\": \"Bob Smith\", \"email\": \"bob@smith.net\"}'\n```\n\n```json\n{\n \"Version\": 2,\n \"Time\": 1436960632,\n \"Additions\": {\n \"email\": \"bob@smith.net\"\n },\n \"Removals\": null,\n \"Changes\": {\n \"name\": {\n \"Before\": \"Bob\",\n \"After\": \"Bob Smith\"\n }\n}\n```\n\nTo get the current state of the object use `get`.\n\n```bash\nscds get bob\n```\n\n```json\n{\n \"Key\": \"bob\",\n \"Value\": {\n \"email\": \"bob@smith.net\",\n \"name\": \"Bob Smith\"\n },\n \"Version\": 2,\n \"Time\": 1436960632\n}\n```\n\nTo get the log of changes over time:\n\n```\nscds log bob\n```\n\n```json\n[\n {\n \"Version\": 1,\n \"Time\": 1436960622,\n \"Additions\": {\n \"name\": \"Bob\"\n },\n \"Removals\": null,\n \"Changes\": null\n },\n {\n \"Version\": 2,\n \"Time\": 1436960632,\n \"Additions\": {\n \"email\": \"bob@smith.net\"\n },\n \"Removals\": null,\n \"Changes\": {\n \"name\": {\n \"Before\": \"Bob\",\n \"After\": \"Bob Smith\"\n }\n }\n }\n]\n```\n\n### HTTP\n\nStart the HTTP server.\n\n```bash\nscds http\n* [http] Listening on locahost:5000\n```\n\nThe input and output of the endpoints match the command-line interface.\n\n- `GET /keys`\n- `PUT /objects/`\n- `GET /objects/`\n- `GET /objects//v/`\n- `GET /objects//t/`\n- `GET /log/` \n\n\n## Notifications\n\nSCDS has built-in support for basic email notifications when new objects are added or when objects change. To subscribe, use the `subscribe` command.\n\n```\nscds subscribe \n```\n\n\n## Dependencies\n\n- MongoDB\n\n\n## Configuration\n\nConfiguration options can be supplied in a file, as environment variables, or command-line arguments (following that precedence). The default configuration options are listed below (in a YAML format).\n\n```yaml\ndebug: false\nconfig: \"\"\nmongo:\n uri: localhost/scds\nhttp:\n host: localhost\n port: 5000\nsmtp:\n host: localhost\n port: 25\n user: \"\"\n password: \"\"\n from: \"\"\n```\n\nEnvironment variables are prefixed with `SCDS_`, are uppercased, and nested options are delimited with an underscore. For example, `SCDS_MONGO_URI` would set the `uri` option in the `mongo` map. Alternately, the command-line flag can be supplied:\n\n```\nscds -mongo.uri dockerhost/scds ...\n```\n\nIf a `scds.yml` file is defined in the working directory, it will be read in automatically. To use an alternate path, the `-config ` (or `SCDS_CONFIG=`) can be used.\n\n## Docker\n\nThe image defaults to running the HTTP interface and looks for a MongoDB server listening on `mongo:27017`.\n\n```\ndocker run -it --link mongo:mongo -p 5000:5000 dbhi/scds\n```\n\n### Compose\n\nA basic Docker Compose file is provided that includes starting a MongoDB container, however it should be changed to mount a volume on the host so the data is persisted.\n\n```\ndocker-compose up -d\n```\n","has_starred","hub_user","immutable_tags_settings",{"_73":11,"_74":75},"enabled","rules",[76],".*","is_automated","permissions",{"_80":17,"_81":11,"_82":11},"read","write","admin","user","storage_size",271917403,"orgData",{"_88":89,"_90":91,"_92":93,"_94":29,"_95":96,"_97":98,"_99":100,"_101":102,"_103":104,"_105":106,"_107":45,"_108":45,"_109":17},"id","179b7bd4bd5e48d293f152a1f403c00d","uuid","179b7bd4-bd5e-48d2-93f1-52a1f403c00d","type","organization","orgname","full_name","Department of Biomedical and Health Informatics","location","Philadelphia, PA","company","The Children's Hospital of Philadelphia","profile_url","http://dbhi.chop.edu/","date_joined","2014-12-28T14:33:29.651561Z","gravatar_url","https://www.gravatar.com/avatar/641d4c98abc8fca6731ad9ada22c6d61?s=80&r=g&d=mm","gravatar_email","badge","is_active","recentTags",[112,149,159],{"_113":41,"_114":115,"_116":117,"_118":119,"_88":120,"_121":122,"_47":137,"_138":115,"_139":140,"_141":54,"_55":142,"_143":144,"_145":128,"_146":137,"_147":64,"_148":17},"content_type","creator",67255,"digest","sha256:016a54d8b3814d81b1b196297e5b8e41e0d18d2410af1afe36d9d78f7a20e2ff","full_size",4087976,570831,"images",[123],{"_124":125,"_116":117,"_126":45,"_127":128,"_129":130,"_131":132,"_133":45,"_134":-5,"_135":119,"_61":64,"_136":-5},"architecture","amd64","features","last_pulled","2026-09-17T11:30:04.360373796Z","last_pushed","2016-06-23T16:15:14Z","os","linux","os_features","os_version","size","variant","2016-06-23T16:15:13.53774Z","last_updater","last_updater_username","bruth","media_type","latest","repository",256238,"tag_last_pulled","tag_last_pushed","tag_status","v2",{"_113":41,"_114":115,"_118":150,"_88":151,"_121":152,"_47":157,"_138":115,"_139":140,"_141":54,"_55":158,"_143":144,"_145":155,"_146":157,"_147":64,"_148":17},4299313,4953846,[153],{"_124":125,"_116":154,"_126":45,"_127":155,"_129":156,"_131":132,"_133":45,"_134":-5,"_135":150,"_61":64,"_136":-5},"sha256:1ed1a431e24ef4619928813b2ae312d50f507b66fbed19691083bbdc2d5181be","2026-09-16T16:10:07.810061103Z","2016-09-20T17:19:58Z","2016-09-20T17:19:57.569468Z","json-schema",{"_113":40,"_114":115,"_118":119,"_88":160,"_121":161,"_47":166,"_138":115,"_139":140,"_141":53,"_55":167,"_143":144,"_145":164,"_146":166,"_147":64,"_148":17},3558699,[162],{"_124":125,"_116":163,"_126":45,"_127":164,"_129":165,"_131":132,"_133":45,"_134":-5,"_135":119,"_61":64,"_136":-5},"sha256:ee92d13f68a616ea84b877a1dea47a23ac68d35d3d84829b08589e0b96fc3f34","2026-09-16T16:25:33.902699254Z","2016-06-23T16:15:21Z","2016-06-23T16:15:20.802268Z","1.0.0","sbxKitMetadata","isPotentialSpam","isHubSbxKitsEnabled","displaySecurityMetadata","tagAttestations","tagsHaveAttestations",[],"routes/_layout.r.$namespace.$reponame.tags",{"_34":177,"_184":185,"_173":201,"_202":11},{"_36":178,"_38":179,"_42":43,"_44":45,"_46":11,"_47":48,"_49":50,"_51":180,"_55":31,"_28":29,"_56":57,"_58":-5,"_59":60,"_61":62,"_63":64,"_65":-5,"_66":60,"_67":68,"_69":11,"_70":29,"_71":181,"_77":17,"_78":183,"_83":29,"_84":85},[],[40,41],[53,54],{"_73":11,"_74":182},[76],{"_80":17,"_81":11,"_82":11},"tags",{"_186":187,"_188":-5,"_189":-5,"_190":191},"count",3,"next","previous","results",[192,195,198],{"_113":41,"_114":115,"_118":150,"_88":151,"_121":193,"_47":157,"_138":115,"_139":140,"_141":54,"_55":158,"_143":144,"_145":155,"_146":157,"_147":64,"_148":17},[194],{"_124":125,"_116":154,"_126":45,"_127":155,"_129":156,"_131":132,"_133":45,"_134":-5,"_135":150,"_61":64,"_136":-5},{"_113":40,"_114":115,"_118":119,"_88":160,"_121":196,"_47":166,"_138":115,"_139":140,"_141":53,"_55":167,"_143":144,"_145":164,"_146":166,"_147":64,"_148":17},[197],{"_124":125,"_116":163,"_126":45,"_127":164,"_129":165,"_131":132,"_133":45,"_134":-5,"_135":119,"_61":64,"_136":-5},{"_113":41,"_114":115,"_116":117,"_118":119,"_88":120,"_121":199,"_47":137,"_138":115,"_139":140,"_141":54,"_55":142,"_143":144,"_145":128,"_146":137,"_147":64,"_148":17},[200],{"_124":125,"_116":117,"_126":45,"_127":128,"_129":130,"_131":132,"_133":45,"_134":-5,"_135":119,"_61":64,"_136":-5},[],"canDeleteTags","actionData","errors"]

dbhi/scds

Tags for dbhi/scds