22b02f1407
feat: add failing test for pagination ( #7924 )
...
* feat: add failing test for pagination
* feat: test
* fix: redis tests
* refactor: remove logs
5 years ago
572bc29742
refactor: shorter map
5 years ago
039710493a
refactor: remove logs
5 years ago
b602c04463
feat: refactor getSortedSetRange to allow big arrays
5 years ago
7e7ea7a697
refactor: dont modify key
5 years ago
1f054c7ecb
fix: redis tests
5 years ago
910b9b8864
fix : #7919 , add useUnifiedTopology
5 years ago
77cb4b55cb
fix : #7892 , handle string 'true'/'false'
6 years ago
9b4ae4c04a
Added Postgres SSL Support ( #7887 )
...
* [Added] Postgres SSL Support
* [Added]Postgres SSL Support
* [Added] Postgres SSL Support
6 years ago
1e0190abef
fix : #7842 , groups.invite works with an array of uids
6 years ago
29f96b199c
fix(style): requiring parens in block bodies
6 years ago
0921230976
fix(style): updated code to follow new eslint recommendations
...
Squashed commit of the following:
commit f9ce878b269b3568f0d649309aae1af4dcfdfeef
Author: Julian Lam <julian@nodebb.org>
Date: Tue Aug 13 14:30:46 2019 -0400
fix(style): updated code to follow new eslint recommendations
commit 80dd370e413f22badb96ff2138e7991dfff6d836
Author: Julian Lam <julian@nodebb.org>
Date: Tue Aug 13 14:14:58 2019 -0400
fix(deps): update dependency sitemap to v4
Squashed commit of the following:
commit f4dd9cabb21e26fdc21f8413be822ea7c64251f8
Author: Julian Lam <julian@nodebb.org>
Date: Tue Aug 13 11:33:05 2019 -0400
fix: resolved breaking changes from sitemap v4 upgrade
commit 9043415ee16dcc27a8dcc2e4479d1bc5e2d1b60e
Merge: e3352b272 72590b346fix : #7831 , fix pagination
convert to async/await
commit c9e83f2374572264855a04156278eef256b0a20c
Author: Barış Soner Uşaklı <barisusakli@gmail.com>
Date: Sun Aug 11 00:14:35 2019 -0400
fix: remove empty line
commit 30be91b26c4dd7583412c4e8d56e9c1688e48a44
Author: Barış Soner Uşaklı <barisusakli@gmail.com>
Date: Sun Aug 11 00:13:41 2019 -0400
fix: remove useless catchs and empty line
commit 2e4a71c0b6104738f15ffbfe3246105b922fdfb3
Author: Renovate Bot <bot@renovateapp.com>
Date: Sat Aug 10 06:51:50 2019 +0000
chore(deps): update dependency eslint-config-airbnb-base to v14
6 years ago
8d4f20865f
fix: redis pubsub not being required correctly
...
split connection logic into separate module
6 years ago
186321e646
fix: mongo.close using wrong client
6 years ago
af1f7249a7
feat: test psql without defineProperty ( #7815 )
...
* feat: test psql without defineProperty
* feat: refactor psql
remove .bind calls, use module.pool.query directly
move requires to top of file
move promisify to bottom so .init etc are promisified
* feat: mongodb
move requires to bottom
* feat: redis
6 years ago
daed76d5d6
feat: cache group:members for priv groups
6 years ago
3b24de4cb3
fix: mongodb tests
6 years ago
fcf3e0770b
feat: #7743 categories
6 years ago
cd2e68cb2d
feat: remove unused code, add 2 tests
6 years ago
53e1b349ae
Change post owner ( #7752 )
...
* feat: #7749 , allow array of keys for setObject
* feat: sortedSetRemoveBulk
* feat: test for bulk remove
* feat: #7083 , ability to change post ownership
* feat: #7083 , fix tid:<tid>:posters
* feat: #7083 , front end
* fix : #7752 , psql methods
* fix: add missing await
* fix: maybe psql
6 years ago
805dcd7ca2
Async refactor in place ( #7736 )
...
* feat: allow both callback&and await
* feat: ignore async key
* feat: callbackify and promisify in same file
* Revert "feat: callbackify and promisify in same file"
This reverts commit cea206a9b8e6d8295310074b18cc82a504487862.
* feat: no need to store .callbackify
* feat: change getTopics to async
* feat: remove .async
* fix: byScore
* feat: rewrite topics/index and social with async/await
* fix: rewrite topics/data.js
fix issue with async.waterfall, only pass result if its not undefined
* feat: add callbackify to redis/psql
* feat: psql use await
* fix: redis 🌋
* feat: less returns
* feat: more await rewrite
* fix: redis tests
* feat: convert sortedSetAdd
rewrite psql transaction to async/await
* feat: 🐶
* feat: test
* feat: log client and query
* feat: log bind
* feat: more logs
* feat: more logs
* feat: check perform
* feat: dont callbackify transaction
* feat: remove logs
* fix: main functions
* feat: more logs
* fix: increment
* fix: rename
* feat: remove cls
* fix: remove console.log
* feat: add deprecation message to .async usage
* feat: update more dbal methods
* fix: redis :voodoo:
* feat: fix redis zrem, convert setObject
* feat: upgrade getObject methods
* fix: psql getObjectField
* fix: redis tests
* feat: getObjectKeys
* feat: getObjectValues
* feat: isObjectField
* fix: add missing return
* feat: delObjectField
* feat: incrObjectField
* fix: add missing await
* feat: remove exposed helpers
* feat: list methods
* feat: flush/empty
* feat: delete
* fix: redis delete all
* feat: get/set
* feat: incr/rename
* feat: type
* feat: expire
* feat: setAdd
* feat: setRemove
* feat: isSetMember
* feat: getSetMembers
* feat: setCount, setRemoveRandom
* feat: zcard,zcount
* feat: sortedSetRank
* feat: isSortedSetMember
* feat: zincrby
* feat: sortedSetLex
* feat: processSortedSet
* fix: add mising await
* feat: debug psql
* fix: psql test
* fix: test
* fix: another test
* fix: test fix
* fix: psql tests
* feat: remove logs
* feat: user arrow func
use builtin async promises
* feat: topic bookmarks
* feat: topic.delete
* feat: topic.restore
* feat: topics.purge
* feat: merge
* feat: suggested
* feat: topics/user.js
* feat: topics modules
* feat: topics/follow
* fix: deprecation msg
* feat: fork
* feat: topics/posts
* feat: sorted/recent
* feat: topic/teaser
* feat: topics/tools
* feat: topics/unread
* feat: add back node versions
disable deprecation notice
wrap async controllers in try/catch
* feat: use db directly
* feat: promisify in place
* fix: redis/psql
* feat: deprecation message
logs for psql
* feat: more logs
* feat: more logs
* feat: logs again
* feat: more logs
* fix: call release
* feat: restore travis, remove logs
* fix: loops
* feat: remove .async. usage
6 years ago
bd640a1107
Topic await errors ( #7727 )
...
* feat: derp await
* feat: restore user.getSettings
* feat: cleanup
* feat: make tid const
* feat: cleanup
* fix: tests
* feat: deprecate filter:controllers.topic.get
* feat: rewrite post-index logic
* feat: change calculation to match others
* fix: use .async
* feat: remove try/catch wrapper
6 years ago
cb51c239f2
feat: remove duped zadds, these are already in topics.onNewPostMade
6 years ago
f8a7cf7378
feat: log data on error
6 years ago
198d05875f
feat: cleanup, use bulk
6 years ago
3ecd703ea3
feat: #7707 , added sortedSetAddBulk
6 years ago
a39f0ef592
fix : #5570 , create per category user post zsets
6 years ago
3780a58ffb
feat: shorter setsCard
6 years ago
ebfc369ade
feat: upgrade to connect-mongo 3.0.0, closes #7693
6 years ago
8d319e4280
fix: psql error
6 years ago
2e6b562f1e
fix: try to fix psql 🐶
6 years ago
31ccc860d3
feat: allow multiple scores in sortedSetsAdd
6 years ago
4d9bc30d1f
feat: async3 upgrade ( #7639 )
...
* feat: async3 upgrade WIP
* fix: async.doWhilst
* fix: async early exit
* fix: psql doUntil
* fix: psql again
6 years ago
2c98dd5f9d
Object cache refactor ( #7558 )
...
* fix: cache refactor
db.getObjectField no longer loads entire object
db.getObjectsFields only clones data once
more tests
* feat: add back cache to redis
db.getObjectField no longer loads entire object
6 years ago
4df925e76a
fix: remove redis object cache
6 years ago
45d7e37ae8
fix: tests
6 years ago
b48b6d75e5
fix: callbacks
6 years ago
7addc5a0e2
fix: return early if keys is empty
6 years ago
b3962c1694
fix: return early if keys is empty
6 years ago
5917dec288
fix: only allow numbers as scores ( #7356 )
...
* zadd score checks
* fix: only allow numbers as scores
* fix: convert values to strings
6 years ago
2e2c3ac110
fix : #7352
6 years ago
fab52b840c
fix: prevent crash if results.stats or results.serverStatus is undefined
6 years ago
a22a3a9861
fix: log error to prevent headers already sent
...
retry on uniq index fail
6 years ago
e1ca2d81f9
refactor: use loash when possible ( #7230 )
6 years ago
3917022a48
fix : #7139
6 years ago
fef7e13c9e
feat: small fixes
6 years ago
d2c2d56f59
feat: change sortedSetsScore
6 years ago
29b63ae7fb
fix : #6979
6 years ago
00afc5b3ab
fix: remove log
6 years ago
eb7ae54f81
Category watch state ( #7109 )
...
* feat: wip, category watch change
* feat: pass data to client
* feat: allow changing state
* fix: account page categories
* fix: show in unread if topic is followed or category is watched
* feat: add default watch state to acp
* feat: save user category watch state
* feat: update unread recent pages
* fix: remove dupe code
* fix: flip conditions
* fix: handle empty arrays
* fix: ignore/watch on others profile
* feat: upgrade script for category states
if there are any users ignoring categories set their state in new zset and delete cid:<cid>:ignorers
* fix: upgrade
* fix: tests
* fix: redis count
* fix: more tests
6 years ago
d117df77f7
fix : #7102
6 years ago
85a07e999b
fix : #7102
6 years ago
263c918088
feat: remove uid:<uid>:ignored:cids ( #7099 )
...
use cid:<cid>:ignorers instead
6 years ago
26ccd8f626
fix: db info page
...
if there is no connection to db, connect first
6 years ago
e65d40c937
dont return undefined from sortedSetsCard if keys is empty or falsy
6 years ago
420227faae
parseFloat scores
6 years ago
6330d51446
less derpy output
6 years ago
ed1bf9a16f
add more info to advanced db page
6 years ago
53ad2bbd6e
Categories optimize ( #6999 )
...
* WIP
* fix category page
* fix counts, and copyPrivileges
* fix lint
* more fixes,
* redis fix
* fix test
* fix category test
* remove getParentsAndChildren
6 years ago
0524fd9caa
closes #6996 ( #6997 )
...
* closes #6996
* fix lint
6 years ago
7b9a2caec3
closes #6994
6 years ago
1c981e638b
rename query name
6 years ago
ca1e3a758b
#6986
6 years ago
48690a01b9
dont need to call multi if keys.length is 0
6 years ago
07f83c5078
fix redis tests
6 years ago
f8e219c323
handle empty set, add test
6 years ago
75816deca7
add cache to redis ( #6917 )
...
* add cache to redis
move out cache module from mongo
* fix redis tests
* add callback noop
* fix typo
* del cache on field delete
* make redis/mongo caches separate
6 years ago
0de60cfdca
fix mongodb tests
6 years ago
8ca36ad122
closes #6890
6 years ago
7aa937a657
remove dupe code in mongodb sorted
6 years ago
c27be9db5a
Recent refactor ( #6879 )
...
* wip
* fix inf scroll
* remove duplicated code
* remove dupe code in /unread
* use topicList
* update tag page to use topicList
* fix tests
* combine ifs
* remove more dupe code
* disable timeout
6 years ago
51792da430
dont crash if there is nothing to write
6 years ago
fb6067a7ca
only parse if field is requested
6 years ago
138154a71c
move modules
6 years ago
b2b33ffa57
topics data refactor
6 years ago
26d4e0852f
use includes instead of indexOf
...
use _.uniq instead of filter&indexOf
6 years ago
986511e718
try with higher timeout
6 years ago
1d15dc089b
revert isCluster
6 years ago
0aebb9caf8
closes #6844
6 years ago
154d7076d9
dont pass options
6 years ago
9dbe68a9cb
testing again
6 years ago
aa567a5f2d
print out connString and opts
6 years ago
2d8d234c57
test mongodb again
6 years ago
e615391b22
convert values to string before removing
6 years ago
18d0deeccb
update deprecated methods ( #6794 )
6 years ago
11b655163e
Only run the DDL for session storage on the primary instance. ( #6788 )
...
This fixes a restart loop caused by deadlocks in large clusters.
6 years ago
9724ef083e
remove v from query
6 years ago
786311fa64
use value
6 years ago
5a69f979a8
update processSortedSet to use withScores
6 years ago
97a3079bc0
Optimize PostgreSQL session store.
...
- Sets session ID to be a constant-sized character field inline in the
table instead of a variable-length character field compressed outside
of the row.
- Changes the session data from "json" to "jsonb" which is faster and
smaller on disk with the drawback of not maintaining key order and
whitespace (which we don't care about at all)
- Adds a clustered index on the session expiration timestamp, which will
make periodic session purging much faster.
(For an example, WTDWTF currently has 482355 sessions in the table, and
because there is no index on the expiration timestamp, PostgreSQL must
check all the rows in the table every time.)
This upgrade script can run concurrently with a live NodeBB instance,
but any action that touches sessions will wait until the upgrade script
is done.
Does not touch the database if the database driver is not set to
PostgreSQL or if there is a Redis database configured.
7 years ago
0519f84734
Promisify modules ( #6723 )
...
* WIP promisify
* promisify psql
* ability to skip some keys
* dont promisify client object
* remove async
* clone entire module so it has all properties
* add shim for node 6
* ignore sessionStore as well
* ignore pool on psql
7 years ago
33228bb7fe
PostgreSQL database driver ( #5861 )
...
* [test/database/list] Fix test list 4 being used in two different tests
* [database/postgres] PostgreSQL database driver
* [database/postgres] Make transactions work based on continuation scope.
* [database/postgres] Implement nested transactions
* eslint --fix
* Add database changes from earlier this week to the PostgreSQL driver.
* Fix typo
* Fix postgres.incrObjectFieldBy returning undefined instead of null when given NaN
* [database/postgres] Fix sortedSetsCard returning an array of strings.
* Update socket.io postgres adapter
* Fix PostgreSQL erroring when multiple updates are made to the same sorted set entry in a single operation.
Add a test case to catch this error.
* Fix lint errors.
* Only prune sessions on one instance in a cluster to avoid deadlocks.
They're caught and handled by the database server, but they spam the logs.
* Fix arguments.slice.
7 years ago
16a7728ab8
fix redis warnings
7 years ago
fe80186ddf
add withscores
7 years ago
8263f81d0c
fix pubsub when only mongodb is used
7 years ago
3b5d6951bb
closes #6499
7 years ago
77d47b31fb
cleanly shutdown
...
wait for webserver to stop accepting connections
destroy current connections
wait for db connection to close
7 years ago
3c4b4f5263
don't call calback twice #6375
7 years ago
be5c237388
fix decr/incrObjectField if key in array doesn't exist create it
7 years ago
6a9a73c86c
changes to leaveAllGroups
...
Groups.destroy can take an array of groupnames
Groups.leave can take an array of groupnames
db.incrObjectField/decrObjectField can take an array of keys
db.sortedSetRemove can take an array of keys and values
db.setRemove can take an array of keys
7 years ago
38acedf5bb
lint
7 years ago
959a742c63
add llen to dbal
7 years ago
bce640e514
closes #6340
7 years ago
7a2d6fe22d
Merge remote-tracking branch 'refs/remotes/origin/master' into develop
7 years ago
b084a596fa
closes #6301
7 years ago
c0b7d4f5b5
fix redis export
7 years ago
8a6345ded7
possible fix for pubsub
7 years ago
e85aabbe74
Allow running as a cluster without Redis ( #6233 )
...
* [database/*] Allow databases other than Redis to provide pubsub for clustering if Redis is not present
* [pubsub] Delay messages sent before the database is ready until the database is ready.
* [pubsub] Restore old behavior of not using the database in non-clustered NodeBB instances.
See comment: https://github.com/NodeBB/NodeBB/pull/6233#issuecomment-357814968
7 years ago
457194b333
Merge branch 'master' into develop
7 years ago
e092778ba6
closes #6200
7 years ago
5b1ed21634
[database/mongo] Improve speed of sortedSetRank ( #6229 )
...
* [database/mongo] Improve speed of sortedSetRank
* [database/mongo] Fix sortedSetRank to filter by _key
7 years ago
5146f43b33
remove console.log
7 years ago
87d40e9e78
fix increment to use data
7 years ago
cbaa977233
fix type on mongodb if key has expireAt
7 years ago
ea8cf6545c
change db.set/get to use data field instead of value
7 years ago
8e04e86e24
closes #5912
7 years ago
5ca3b535e7
closes #6105
7 years ago
dbf815ed47
closes #6103
7 years ago
30ae0a5499
another process.nextTick
7 years ago
e187a0def2
fix method name
7 years ago
12546cb9ad
break up sync operation
7 years ago
7e0d0e0eb5
Merge remote-tracking branch 'origin/develop'
7 years ago
54a84bf130
cache fixes
7 years ago
43f9c3224f
dont crash sortedSetIncryBy on redis if no callback is supplied
7 years ago
e609e497b3
Provide more error information to logs
...
Provides full stack instead of just message
7 years ago
a73c2628c4
cache improvements, stats
7 years ago
e7318a1cea
Mongo cache ( #6002 )
...
* cache mongodb objects
remove user settings cache since it is cached at the object level
* removed indexOf from isMemberOfSets
* change has to get, change maxAge to 0
7 years ago
7ad4420b6a
closes #6000
7 years ago
108f84fd19
add type to dbal
7 years ago
62c81ca0d3
fix lint
8 years ago
329bfeeb3b
convert min/max to float
8 years ago
923bd86662
Widgets refactor ( #5817 )
...
* widgets refactor
render widgets server side
widgets can use all the data the template can use
* fix tests
8 years ago
e0de922ede
Revert "widgets refactor"
...
This reverts commit 9e94edb5aa
8 years ago
9e94edb5aa
widgets refactor
...
render widgets server side
widgets can use all the data the template can use
8 years ago
d469f53eba
using async in batch
...
removed unused code in debug
8 years ago
3d85992757
modify db.processSortedSet so it works with intervals
8 years ago
7fe239229d
show 3 digits
8 years ago
3c2d4fe649
Switch from underscore to lodash
8 years ago
890c2eff70
style changes
8 years ago
fe0a5aaf28
fix redis tests
8 years ago
fd0043f36a
more tests
8 years ago
95196ceedc
closes #5692
8 years ago
54a9e7eab9
#5674
8 years ago
33f135c091
closes #5675
8 years ago
ad14b0d60b
more fixes for #5660
8 years ago
7135d25a4a
closes #5654
8 years ago
14f3907aa4
change the way group member posts are stored
8 years ago
b91b41dfa3
show database values in gbs
8 years ago
ba51a6c746
fix underscore
8 years ago
b7b65c7d63
change style
8 years ago
Barış Soner Uşaklı
David Karrick
Julian Lam
Peter Jaszkowiak
Barış Soner Uşaklı
Ben Lubar
Ben Lubar