Difference between revisions of "TODO"

From Minetest Developer Wiki
Jump to navigation Jump to search
(→‎TODO in Luanti: Add the rename to TODO list)
 
(83 intermediate revisions by 22 users not shown)
Line 1: Line 1:
 +
{{Mbox|type=issue|text='''Checkout the [https://github.com/minetest/minetest/blob/master/doc/direction.md roadmap] instead'''<br/>The roadmap outlines a consensus on medium-term Luanti development. This page contains other wishlist items from core developers, but hasn't necessarily reached a consensus and may be long term.}}
 +
 +
== TODO in Luanti ==
 +
=== Things to do soon ===
 +
 +
* [https://github.com/minetest/minetest/issues/15322 Complete the rename from Minetest to Luanti]
 +
 +
==== Mapgen ====
  
−
== Things to do right away ==
 
−
=== Mapgen ===
 
−
* DecorationDef
 
 
* Add configuration for DungeonGen
 
* Add configuration for DungeonGen
 
* Add configuration for CaveGen
 
* Add configuration for CaveGen
−
* Add Lua callbacks for DungeonGen room placement - this comes with DecorationDef, I reckon
 
−
* Make permanent solution for caves spawning inside of trees - Can do this by checking if is_ground_content, now.
 
  
−
=== MapVoxelManipulator ===
+
==== DecorationDef ====
−
* Figure out a permanent, elegant solution to the walled-in cave problem - can use is_ground_content now
+
 
 +
* Add cutoff handling
 +
 
 +
==== BiomeDefManager ====
 +
 
 +
* Add biomemap cache
 +
* Scale temperature and humidity noise to more sensible value ranges
 +
* Add biome weight attribute
 +
* Find out how to account for elevation better!
 +
* Add Voronoi diagram maker? https://forum.minetest.net/viewtopic.php?f=9&t=13163
 +
 
 +
==== MapVoxelManipulator ====
 +
 
 +
* Figure out a permanent, elegant solution to the walled-in cave problem - can use is_ground_content now - does this belong in VoxelManipulator?
 +
 
 +
==== EmergeThread ====
  
−
=== EmergeThread ===
 
 
* Figure out the thread priority mess
 
* Figure out the thread priority mess
 
* Assign thread affinities for a bit of a performance boost (reduce L2 cache misses)
 
* Assign thread affinities for a bit of a performance boost (reduce L2 cache misses)
  
−
=== Other ===
+
==== GUIs / Formspecs ====
−
* Merge leveldb pull request
+
 
 +
* New main menu, which promotes Luanti better [https://github.com/minetest/minetest/issues/6733 6733]
 +
* Refactor formspec / GUI code to be independent from serialisation [https://github.com/minetest/minetest/issues/9358 9358]
 +
* Add new GUI API, probably based on a Lua DSL [https://github.com/minetest/minetest/issues/6527 6527]
 +
* New GUI default theme [https://github.com/minetest/minetest/issues/9802 9802]
 +
 
 +
==== Other ====
 +
 
 +
* Make a library for reading a Luanti map without worrying about the database used. (libmtmap?)
 +
* Add block tinting (grass, water, sky, etc.) (for biomes)
 
* Add Fullbright option
 
* Add Fullbright option
−
* Re-do rollback to not be slow
 
−
* Fix ClearObjects
 
−
** Add an option for active objects only
 
−
** Unload non-persistent entities from blocks on block unload?
 
−
** Add an upper bound to the number of MapBlocks that can be loaded at once - this is the most effective option
 
  
−
<br />
+
=== Big, long term goals (Client) ===
 +
 
 +
==== Client-Side Scripting (CSM) ====
 +
See original plans: [[Client_scripting_plans]]
 +
 
 +
* Server-Sent Client-Side Modding (SSCSM)
 +
* Client-side prediction APIs
 +
* GUI APIs
 +
 
 +
==== Client-Side Biomes ====
 +
The server should transfer biome definitions to the client which calculates biomes locally.
 +
Crossing over into a new biome should trigger a client-side script callback
 +
Biomes have effects:
 +
* Full scene post-effects (tint everything a different color)
 +
* Temporarily override settings (cloud_height, enable_clouds, water_wave_height, water_wave_length, water_wave_speed)
 +
 
 +
==== Hardware Lighting for Light Sources ====
  
−
== Big, long term goals ==
 
−
=== Lua MapVoxelManipulator Interface ===
 
 
''' Description '''<br />
 
''' Description '''<br />
−
Practically any mod that is more complex than the little clicky thing on the end of ink pens would want to modify portions of the map. To do this, a minetest.env:set_node() call is required for each node to be modified. It does not take much imagination to arrive at the conclusion that the performance of these mods suffer accordingly, due to not only the inherent slowness of Lua, but the overhead of Lua-to-C calls, and the overhead of each Map::setNode() call. To make matters even worse, all this must be done within an envlock, leaving the rest of the server unresponsive while the Lua mods do their thing. Absolutely disgusting.<br />
+
Benefits:
−
The answer is to give the Lua API the power of the ManualMapVoxelManipulator, so nodes may be retrieved or modified through a 3d array, and then blit (if necessary) back to the map.<br />
+
 
−
''' What needs to be done '''
+
* would allow variable light range and cutoff
−
* The API for this needs to be well thought-out - no afterthoughts or hacky looking pieces.
+
* would free up param1 of MapNodes to be used for storing more immediate node metadata (always a good thing!).
−
* The central structure of the VoxelManipulator will be the data itself - a 3D array (in Lua, a table containing tables containing tables of MapNodes), or even better, just one huge array, leaving the modders responsible for finding the index within the array (the latter would surely improve performance).
+
* would allow colored light sources
−
* An API to simply read blocks of map to an array without any intentions of modifying it. An envlock would only be required when initially reading from the map to the VoxelManipulator.
+
 
−
* An API to read blocks of map, then blit back to the map when done. An envlock is required throughout the lifetime of the object (unless you're not concerned with the contents of the map being modified in between the mod doing so).
+
Of course, can use dynamic lights, except they're very intensive and generally a scarce resource
−
* An API to create a blank VoxelManipulator, perhaps filled with CONTENT_IGNORE, to which the mod sets only some blocks, and is blitted back to the map (CONTENT_IGNORE nodes aren't set, obviously). Here, an envlock would only be required when blitting back changes.
+
Dynamically generated lightmaps seem like a good way forward. <br />
 +
http://joshbeam.com/articles/dynamic_lightmaps_in_opengl/
 +
<br />
 +
RealBadAngel is currently working on shader-based lighting. ''What strategy is he using?''
 
<br />
 
<br />
−
=== Voxel Area Entities ===
+
 
 +
==== Occlusion Culling/Occlusion Query ====
 +
 
 +
Irrlicht does support occlusion culling.  If enabled, it culls scene nodes which are entirely out of the camera's view fulcrum. <br />
 +
Problem:  The entire map is an Irrlicht scene node. ''Why? What was the rationale for this decision?''<br />
 +
Solution:  Make scene nodes per MapBlock. <br />
 +
While we're at it, playing around with scene nodes, it'd probably be a good idea to maintain two (or three) separate nodes for each MapBlock, one for each type of material.  Opaque, transparent, and liquid drawtypes.  This fixes the still unsolved material transparency problem.
 +
 
 +
=== Big, long term goals (Server) ===
 +
 
 +
==== Voxel Area Entities ====
 +
 
 
''' Description '''<br />
 
''' Description '''<br />
−
How cool would it be to build a full-sized boat in Minetest, and then drive it around the ocean? That's one example of something that would be possible with this feature.<br />
+
How cool would it be to build a full-sized boat in Luanti, and then drive it around the ocean? That's one example of something that would be possible with this feature.<br />
 
Voxel Area Entities are moveable ActiveObjects whose mesh and texture is user-modifiable via setting MapNodes in it. This is an extremely powerful feature, and while perhaps not of extreme difficulty to implement, there is very much to be done.<br />
 
Voxel Area Entities are moveable ActiveObjects whose mesh and texture is user-modifiable via setting MapNodes in it. This is an extremely powerful feature, and while perhaps not of extreme difficulty to implement, there is very much to be done.<br />
 
''' What needs to be done '''
 
''' What needs to be done '''
Line 48: Line 97:
 
* Some way to store these in the map. Perhaps these objects will get special non-block-ID keys in the map DB.
 
* Some way to store these in the map. Perhaps these objects will get special non-block-ID keys in the map DB.
 
* A decent way to serialize these objects. This detail in particular will require special attention.
 
* A decent way to serialize these objects. This detail in particular will require special attention.
 +
* For the previous two points, see http://irc.minetest.net/minetest-dev/2013-10-21#i_3383926 for a discussion of a possible way to handle the objects.
 
<br />
 
<br />
−
=== Envlock Scope Reduction ===
+
 
 +
==== Envlock Scope Reduction ====
 +
 
 
''' Description '''<br />
 
''' Description '''<br />
−
Envlock needs to be put on a diet. Seriously. This is believed to be the primary reason for perceived unresponsiveness in Minetest - solving this would help matters immensely.<br />
+
Envlock needs to be put on a diet. Seriously. This is believed to be the primary reason for perceived unresponsiveness in Luanti - solving this would help matters immensely.<br />
 
''' What needs to be done '''
 
''' What needs to be done '''
 
* Add a thin abstraction layer for atomic operation intrinsics.
 
* Add a thin abstraction layer for atomic operation intrinsics.
Line 59: Line 111:
 
<br />
 
<br />
  
−
=== SSE/AVX Perlin Noise ===
+
==== Pre-generate world ====
 +
 
 
''' Description '''<br />
 
''' Description '''<br />
−
Calculation of perlin noise maps are embarassingly parallel. Using SSE or AVX for the gradient map methods will speed up computations by a factor of 4 or 8. This is not needed anytime soon, as perlin noise is very cheap currently.<br />
 
 
''' What needs to be done '''
 
''' What needs to be done '''
−
* Finish implementing it
 
−
* Test
 
−
* Do the same for NEON on arm
 
−
<br />
 
−
=== Mapgen V7 ===
 
−
''' Description '''<br />
 
−
The highly anticipated, next-generation biome-based map generator, what more is there to say?<br />
 
−
This "big feature" has a higher priority than the others, since it is mostly done already and is in high demand from the Minetest community.<br />
 
−
Mapgen V7 is [[Mapgen_V7|fully described here]]<br />
 
−
''' What needs to be done '''
 
−
* Polish code up
 
−
* Add biome Voronoi diagram generator
 
−
* Add all Minecraft biomes
 
−
* Implement DecorationDef
 
−
* Nether and aether biomes - should handle this case separately from biomes, probably, calls to each their own respective generateTerrain().
 
 
<br />
 
<br />
  
−
=== Mapgen V5 ===
+
==== Add colorlike to node param types ====
−
''' Description '''<br />
 
−
Revival of the 3d perlin noise-based generator that produced excellent looking terrain. Used to be very slow, which is the reason why it was ultimately dumped for V6 - this is no longer a problem with the new perlin noise map functions, which are insanely fast. celeron55 specifically requested to be the one to do this.<br />
 
−
''' What needs to be done '''
 
−
* Class-ify the V5 mapgen code. Create noise objects and handle parameters in the constructor, destroy noise objects in the destructor.
 
−
* Replace all NoiseBuffer calls with array accesses to the 3d noise result array
 
−
* Replace lighting and liquid updates with calls to the parent Mapgen class' updateLiquid() and updateLighting(). Replace cave, dungeon, and tree generation with the appropriate generalized calls too.
 
−
* Overall code cleanup would be nice in addition.
 
−
<br />
 
−
=== Pre-generate world ===
 
−
''' Description '''<br />
 
−
''' What needs to be done '''
 
−
<br />
 
  
−
=== Store block differences only ===
 
 
''' Description '''<br />
 
''' Description '''<br />
−
Instead of storing everything in the database, only store the changed mapblocks (or even only modified nodes?).  This would save a lot of space.<br />
+
Add a field like facedir, wallmounted, and liquidlike called colorlike that will allow the user to register a set of colors so that the color of some base node is modified on draw.  This would save many node definitions.<br />
−
''' What needs to be done '''
+
This field would be (part of, at least) param2 in a MapNode.  If colorlike is specified on its own, then it can define and use up to 256 colors. If used with facedir or wallmounted, then, it can only define and use 8 colors.
−
* Change the mapblock saving code to only save modified blocks.
 
−
* Change the mapblock loading code to mapgen, and then load changed blocks.
 
 
<br />
 
<br />
−
=== Rivers ===
 
−
''' Description '''<br />
 
−
Add rivers to map generator.<br />
 
−
Did some work on rivers alongside Mapgen V7.  Unexpectedly, applying logarithm to terrain height seems to work rather well for this.  For 1 < x < 0, log(x) returns a steeply decreasing negative number, below the typical water_level.  The rather short interval in which this result occurs draws an outline between higher regions of noise.  Unfortunately, the overall level of quality of rivers created with this method is low.  Rivers tend to be in a closed loop, vary too greatly in width, and don't branch off to other streams.<br />
 
−
<gallery>
 
−
File:logrivers.png|Rivers generated using the logarithm method.
 
−
File:riverattempt.jpg|An attempt at superimposing rivers onto normally-generated terrain
 
−
File:riverattempt2.jpg|Another screenshot from a different position of the same map
 
−
</gallery>
 
 
''' What needs to be done '''<br />
 
''' What needs to be done '''<br />
−
* Find an algorithm to produce nice rivers (Lightning fractal algorithm is a decent candidate)
+
* Store a color LUT with the ContentFeatures for the defined node that is to be passed along from Lua when registering the node.
−
* Find a way to make them completely connected from block-to-block (difficult)
+
* Figure out how to draw these colors in inventory screens and what not without having to prerender more textures
 +
* Bump ContentFeatures version
 
<br />
 
<br />
  
−
=== Add colorlike to node param types ===
+
==== Rewrite falling code to C++ ====
 +
 
 
''' Description '''<br />
 
''' Description '''<br />
−
Add a field like facedir, wallmounted, and liquidlike called colorlike that will allow the user to register a set of colors so that the color of some base node is modified on draw. This would save many textures and node definitions.<br />
+
nodeupdate() now very slow and can't handle large amount of falling nodes.
−
This field would be (part of, at least) param2 in a MapNode. If colorlike is specified on its own, then it can define and use up to 256 colors.  If used with facedir or wallmounted, then, it can only define and use 8 colors.
+
100-1000 falling nodes now makes server very slow, 10000+ cause segfault.
 +
To test - make sand floating island via mapgen, touch it
 
<br />
 
<br />
 
''' What needs to be done '''<br />
 
''' What needs to be done '''<br />
−
* Store a color LUT with the ContentFeatures for the defined node that is to be passed along from Lua when registering the node.
+
Rewrite in core with queue (like Map::transformLiquids)
−
* Figure out how to draw these colors in inventory screens and what not without having to prerender more textures
 
−
* Bump ContentFeatures version
 
 
<br />
 
<br />
  
−
== TODO in minetest_game ==
+
==== Pathfinder ====
−
===== To do immediately =====
+
See [[Pathfinder wishlist]].
−
* Make gold not look like American cheese
 
−
* Use a new texture for bronze blocks (and for other ore blocks too)
 
−
===== Gameplay mechanics =====
 
−
* Beds? Need to think about this one more. [http://forum.minetest.net/viewtopic.php?id=2625 Beds Mod]
 
−
* Enderballs (or at least the teleportation aspect of it in something else). ''[http://forum.minetest.net/viewtopic.php?id=2805 Throwing mod by PilzAdam] has teleport arrows; use mese crystal fragments for teleportation?''
 
−
===== Add things to surface =====
 
−
(so we do have something else than mining)
 
−
* More trees. ''Not as a mod, nodes will be added on request if they are added to mapgen'' [http://forum.minetest.net/viewtopic.php?id=4394 More Trees Mod]
 
−
===== Sounds =====
 
−
Collect some (not annoying) sounds from somewhere and add them in.
 
  
−
== Other ==
+
=== Big protocol changes ===
−
* Remove support for optdepends.txt at the end of 2013 https://github.com/minetest/minetest/commit/969d2b3eb1f30e257823d9220697e47735be68e3
+
 
−
* Remove supoort for common mods after 0.4.7 or so https://github.com/minetest/minetest/commit/306d1ab866a3ce820e95f4faf805684cd4122ae4
+
There are several features that would probably bring benefits in the long term, but can't currently be merged because of network protocol incompatibility.
 +
That is, they either can't be implemented in a way that lets old clients connect to new servers and new clients to old servers, or it would be a major pain to do so.
 +
The point of this section is to list such features so that they can be merged at once: a one-time incompatibility, perhaps coinciding with the release of 0.5.0,
 +
is better than breaking compatibility all the time.
 +
'''Note: ''' Not all of the things listed below need to be done, these are just ideas.
 +
* A binary key-value storage which easily supports missing fields with default values (e.g. [https://github.com/celeron55/minetest/blob/meta_set_nodedef_2/src/util/template_serialize.h header], [https://github.com/celeron55/minetest/blob/meta_set_nodedef_2/src/util/template_serialize.cpp source], [https://github.com/celeron55/minetest/blob/meta_set_nodedef_2/src/nodedef.cpp#L327 usage])
 +
* Using TCP for reliable data transfer (e.g. [https://github.com/celeron55/minetest/tree/tcp_connection tcp_connection])
 +
* Make the client request mapblocks (e.g. [https://github.com/celeron55/minetest/tree/tcp_blocks_2 tcp_blocks_2])
 +
* Improved authentication and encryption
 +
* Remove old compatibility kludges.
 +
* Many command IDs have become obsolete in the protocol: they could be consolidated
 +
* Change builtin CONTENT_* to 0, 1, 2
 +
<br />
  
 
== See also ==
 
== See also ==
 +
* [https://wiki.minetest.net/Terminology Terminology]
  
−
* [[Terminology]]
+
[[Category:Core Engine]]
 +
[[Category:Proposal‏‎]]

Latest revision as of 13:11, 24 October 2024

Mbox important.png Checkout the roadmap instead
The roadmap outlines a consensus on medium-term Luanti development. This page contains other wishlist items from core developers, but hasn't necessarily reached a consensus and may be long term.

TODO in Luanti

Things to do soon

Mapgen

  • Add configuration for DungeonGen
  • Add configuration for CaveGen

DecorationDef

  • Add cutoff handling

BiomeDefManager

MapVoxelManipulator

  • Figure out a permanent, elegant solution to the walled-in cave problem - can use is_ground_content now - does this belong in VoxelManipulator?

EmergeThread

  • Figure out the thread priority mess
  • Assign thread affinities for a bit of a performance boost (reduce L2 cache misses)

GUIs / Formspecs

  • New main menu, which promotes Luanti better 6733
  • Refactor formspec / GUI code to be independent from serialisation 9358
  • Add new GUI API, probably based on a Lua DSL 6527
  • New GUI default theme 9802

Other

  • Make a library for reading a Luanti map without worrying about the database used. (libmtmap?)
  • Add block tinting (grass, water, sky, etc.) (for biomes)
  • Add Fullbright option

Big, long term goals (Client)

Client-Side Scripting (CSM)

See original plans: Client_scripting_plans

  • Server-Sent Client-Side Modding (SSCSM)
  • Client-side prediction APIs
  • GUI APIs

Client-Side Biomes

The server should transfer biome definitions to the client which calculates biomes locally. Crossing over into a new biome should trigger a client-side script callback Biomes have effects: 

* Full scene post-effects (tint everything a different color)
* Temporarily override settings (cloud_height, enable_clouds, water_wave_height, water_wave_length, water_wave_speed)

Hardware Lighting for Light Sources

Description
Benefits:

  • would allow variable light range and cutoff
  • would free up param1 of MapNodes to be used for storing more immediate node metadata (always a good thing!).
  • would allow colored light sources

Of course, can use dynamic lights, except they're very intensive and generally a scarce resource Dynamically generated lightmaps seem like a good way forward.
http://joshbeam.com/articles/dynamic_lightmaps_in_opengl/
RealBadAngel is currently working on shader-based lighting. What strategy is he using?

Occlusion Culling/Occlusion Query

Irrlicht does support occlusion culling. If enabled, it culls scene nodes which are entirely out of the camera's view fulcrum.
Problem: The entire map is an Irrlicht scene node. Why? What was the rationale for this decision?
Solution: Make scene nodes per MapBlock.
While we're at it, playing around with scene nodes, it'd probably be a good idea to maintain two (or three) separate nodes for each MapBlock, one for each type of material. Opaque, transparent, and liquid drawtypes. This fixes the still unsolved material transparency problem.

Big, long term goals (Server)

Voxel Area Entities

Description
How cool would it be to build a full-sized boat in Luanti, and then drive it around the ocean? That's one example of something that would be possible with this feature.
Voxel Area Entities are moveable ActiveObjects whose mesh and texture is user-modifiable via setting MapNodes in it. This is an extremely powerful feature, and while perhaps not of extreme difficulty to implement, there is very much to be done.
What needs to be done

  • A new derived SAO and CAO (they would need to be treated fundamentally differently), along with setNode() and removeNode() calls.
  • A derived VoxelManipulator class, perhaps called ObjectVoxelManipulator, which will be used to manipulate them.
  • These types of objects have meshes, and will need to be updated in MeshUpdateThread along with MapBlocks.
  • Some way to store these in the map. Perhaps these objects will get special non-block-ID keys in the map DB.
  • A decent way to serialize these objects. This detail in particular will require special attention.
  • For the previous two points, see http://irc.minetest.net/minetest-dev/2013-10-21#i_3383926 for a discussion of a possible way to handle the objects.


Envlock Scope Reduction

Description
Envlock needs to be put on a diet. Seriously. This is believed to be the primary reason for perceived unresponsiveness in Luanti - solving this would help matters immensely.
What needs to be done

  • Add a thin abstraction layer for atomic operation intrinsics.
  • Replace Environment operations that require concurrency but are simple enough with the said atomic operations and clever ordering.
  • Add a thread-safe hashtable structure to be used instead of std::map (or core::map) where locks would be needed, make use of this.
  • RCU for Map things - big structures such as MapBlocks could benefit from Read-Copy-Update for synchronization. This is the biggest change, but the reward would be immense.


Pre-generate world

Description
What needs to be done

Add colorlike to node param types

Description
Add a field like facedir, wallmounted, and liquidlike called colorlike that will allow the user to register a set of colors so that the color of some base node is modified on draw. This would save many node definitions.
This field would be (part of, at least) param2 in a MapNode. If colorlike is specified on its own, then it can define and use up to 256 colors. If used with facedir or wallmounted, then, it can only define and use 8 colors.
What needs to be done

  • Store a color LUT with the ContentFeatures for the defined node that is to be passed along from Lua when registering the node.
  • Figure out how to draw these colors in inventory screens and what not without having to prerender more textures
  • Bump ContentFeatures version


Rewrite falling code to C++

Description
nodeupdate() now very slow and can't handle large amount of falling nodes. 100-1000 falling nodes now makes server very slow, 10000+ cause segfault. To test - make sand floating island via mapgen, touch it
What needs to be done
Rewrite in core with queue (like Map::transformLiquids)

Pathfinder

See Pathfinder wishlist.

Big protocol changes

There are several features that would probably bring benefits in the long term, but can't currently be merged because of network protocol incompatibility. That is, they either can't be implemented in a way that lets old clients connect to new servers and new clients to old servers, or it would be a major pain to do so. The point of this section is to list such features so that they can be merged at once: a one-time incompatibility, perhaps coinciding with the release of 0.5.0, is better than breaking compatibility all the time. Note: Not all of the things listed below need to be done, these are just ideas.

  • A binary key-value storage which easily supports missing fields with default values (e.g. header, source, usage)
  • Using TCP for reliable data transfer (e.g. tcp_connection)
  • Make the client request mapblocks (e.g. tcp_blocks_2)
  • Improved authentication and encryption
  • Remove old compatibility kludges.
  • Many command IDs have become obsolete in the protocol: they could be consolidated
  • Change builtin CONTENT_* to 0, 1, 2


See also

Retrieved from "http://dev.minetest.net/index.php?title=TODO&oldid=6611"